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GAUSSIAN  ARBITRARILY  VARYING  CHANNELS 


1.  INTRODUCTION 

Consider  the  following  communications  channel  (cf.  Fig.  1).  Once  each  second,  the  transmitter 
chooses  for  transmission  to  the  receiver  an  arbitrary  real  number,  say  u,  at  time  /,  such  that  the 
sequence  {  «,  )  satisfies  a  power  constraint  Pt  (to  be  made  precise  below).  In  transmission,  this 
number  is  corrupted  in  such  a  way  that  it  is  received  as  «,  +  n*  +  s,.  The  elements  of  the  sequence 
( «*,  )  are  independent,  zero-mean  Gaussian  random  variables,  each  having  variance  Nr.  The 
transmitter  and  the  receiver  have  no  knowledge  of  the  sequence  { s, },  other  than  that  it  satisfies  a  cer¬ 
tain  power  constraint,  say  Pj  (also  to  be  made  precise  below).  The  sequences,}  may  have  arbitrary, 
time-varying,  possibly  non-Gaussian  statistics.  The  goal  of  the  transmitter  and  receiver  is  to  construct  a 
coding  system  to  reliably  convey  discrete  source  data  over  this  channel,  knowing  only  Ne  ,  PT ,  and  Pj. 


Fig  1  —  A  Gaussian  arbitrarily  varying  channel 

We  call  the  preceding  model  a  Gaussian  Arbitrarily  Varying  Channel  (GAVC),  since  it  is  the  con¬ 
tinuous  alphabet,  Gaussian-noise-corrupted  analog  of  the  discrete,  memoryless.  Arbitrarily  Varying 
Channel  (AVC),  introduced  by  Blackwell,  Breiman  and  Thomasian  [1]  (see  also  Wolfowitz  (2,31).  The 
study  of  discrete,  memoryless  AVCs  has  generated  a  substantial  body  of  literature;  much  of  this  is  sum¬ 
marized  in  Ref.  3,  chapter  6. 

By  comparison,  GAVCs  have  received  considerably  less  attention.  Blachman  [4,  5],  has  obtained 
upper  and  lower  bounds  on  the  capacity  of  a  GAVC  (using  the  maximum  probability  of  error  concept) 
when  the  sequence  { s, )  is  allowed  to  be  chosen  with  foreknowledge  of  the  transmitter’s  codeword. 
Basar  and  Wu  [6]  have  investigated  the  use  of  essentially  the  same  channel,  for  a  different  source 
transmission  problem  in  which  the  source  is  a  discrete-time,  memoryless  Gaussian  source  and  reliability 
is  measured  by  mean-square  distortion.  Dobrushin  [7]  and  later  McEliece  and  Stark  [8]  have  studied 
what  might  be  called  a  Gaussian  compound  channel  [2,3]  that  is  similar  to  the  GAVC  except  that  the 
j  s, )  is  constrained  to  be  a  sequence  of  independent,  identically  distributed  random  variables. 

The  practical  significance  of  the  GAVC  is  seen  as  follows.  One  may  view  the  sequence  (  s, }  as 
selected  by  an  intelligent  and  unpredictable  adversary,  namely  the  jammer ,  whose  intent  is  to  disrupt 
the  transmission  of  the  sequence  (  u, )  as  much  as  possible.  The  jammer,  like  the  transmitter,  is  subject 
to  the  natural  constraint  of  finite  power  but  is  otherwise  free  to  generate  any  signal  he  chooses. 
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in  this  report,  we  study  four  GAVCs  corresponding  to  two  different  types  of  power  constraints 
(peak  and  average)  on  the  transmitted  codeword  and  on  the  jamming  sequence.  Our  main  results  are 
coding  theorems,  one  for  each  pair  of  constraints,  characterizing  the  asymptotic  reliability  that  can  be 
achieved  b>  optimum  random  codes  on  these  channels.  We  say  "asymptotic  reliability"  rather  than 
capacity  because,  as  we  shall  find,  these  channels  generally  have  no  capacity,  per  se. 

2.  DEFINITIONS  AND  RESULTS 

A  codeword  of  length  n  for  the  GAVC  is  a  sequence  of  n  real  numbers  selected  by  the 
transmitter,  say  u  =  (  U\,  ...,//„ ).  Similarly,  a  jamming  sequence  of  length  //,  denoted  by  s  = 
(  S|, . . . ,  s„),  is  a  sequence  of  n  real  numbers  selected  by  the  jammer.  These  sequences  may  be  thought 
of  geometrically  as  points  in  //-dimensional  Euclidean  space  (Rn  ).  With  this  interpretation,  the  output 
of  the  GAVC  corresponding  to  the  codeword  u  and  the  jamming  sequence  s  is 

y*  =  u  +  T)*  +  s,  (2.1) 

where  rjJ  denotes  an  //-vector  of  independent,  identically  distributed  (i.i.d.)  N  (0,  Ne)  random  vari- 
ables.t 

An  (n.  M)  block  code,  C„ ,  is  a  system* 

C„  =  {  (u,,  D\ ), . (um,Dm)},  (2.2) 

where  (u, )  *i\  are  codewords  of  length  //,  and  (  D, }  “i  are  disjoint  (Borel)  subsets  of  R",  called  decod¬ 
ing  sets.  This  code  may  be  interpreted  as  a  means  of  transmitting  an  integer  message  from  the  set 
(  1,...,  M )  to  the  receiver  using  the  GAVC.  To  send  the  number  1<  /<  M ,  the  transmitter  sends 
the  codeword  u,.  At  the  receiving  end,  if  the  received  sequence  y*  lies  in  the  set  D„  the  receiver 
infers  (perhaps  incorrectly)  that  the  transmitted  message  was  /’;  otherwise,  if  y*  is  exterior  to  each 
decoding  set,  the  receiver  draws  no  conclusion  about  the  transmitted  message. 

We  are  interested  in  the  problem  of  transmitting  the  output  of  a  given  information  source,  gen¬ 
erating  R  bits  per  second,  over  the  GAVC  with  minimum  error  probability  (to  be  defined).  The  goal 
of  the  transmitter  is  to  construct  a  block  coding  system  of  length  n  that  suffers  an  error  probability  no 
greater  than  this  minimum,  regardless  of  the  jamming  sequence  s.  The  goal  of  the  jammer  is  to  inflict 
the  largest  possible  error  probability  on  any  code  chosen  by  the  transmitter  by  an  appropriate  choice  of 
s  For  the  transmitter,  a  strategy  to  accomplish  this  goal  consists  of  an  ( n ,  2nR  )  code;  a  strategy  for 
the  jammer  is  a  jamming  sequence  of  length  n. 

We  allow  both  transmitter  and  jammer  the  additional  flexibility  of  being  able  to  choose  their 
respective  strategies  randomly.  Accordingly,  we  define  an  (  n  ,  M  )  random  (block)  code, 

C'n  =  {  (uj\  Of) . (uj, ,  DJ, )  }  ,  (2.3) 

to  be  an  (  n  ,  M )  code-valued  random  variable  that  satisfies  the  obvious  measurability  requirements.  A 
(random)  jamming  sequence  of  length  //,  with  the  obvious  definition,  is  denoted  by  s*. 

Clearly,  if  no  further  restrictions  are  imposed  on  the  random  codes  and  jamming  sequences,  the 
problem  has  an  uninteresting  solution.  The  error  probability  of  any  fixed,  positive  rale,  random  code 
can  be  made  arbitrarily  close  to  one  by  letting  s*  be  memoryless,  zero-mean,  Gaussian  noise  of  arbi¬ 
trarily  large  variance  (or  power)  In  practice,  however,  there  will  be  other  restrictions  that  prevent  such 


*  Throughout  this  report,  except  where  otherwise  indicated,  asterisks  arc  used  as  superscripts  to  denote  random  variables,  hold 
lower  case  letters  indicate  vectors  (or  vector-valued  mappings)  in  R",  and  N  (/i.o2)  denotes  a  Gaussian  distribution  with  mean 
n  and  variance  <r2 

tWc  extend  this  definition  to  nonintcgral  M  as  follows  By  an  (n.  M)  code  we  mean  an  (n.M'l  code  where  M'  is  the  smallest 
integer  greater  than  or  enual  to  M 
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trivial  solutions.  An  interesting  and  natural  restriction  to  investigate  is  that  of  placing  some  kind  of 
power  constraint  on  the  codewords  and  the  jamming  sequences.  In  this  report,  we  consider  two  types  of 
power  constraints:  peak  and  average.  We  say  that  C*  satisfies  a  peak  input  power  constraint  (PI)  if  each 
codeword  lies  on  or  within  an  n -dimensional  sphere  ( n-sphere )  of  radius  yJnPr  almost  surely  (a.s.),  i.e., 
if  for  each  1  <  i  <  M,  the  codeword  u*=  (u*, . u*„  )  satisfies 

-  I  u*J  «;  PT  (a.s.).  (2.4) 

"  /-i 

This  code  satisfies  an  average  input  power  constraint  (AI)  if  the  expected  power  averaged  over  all  code¬ 
words  is  at  most  Pr;  i.e.,  if 


E 


1  M 
—  y 

"M  ,r, 


I 

-  l 


^  P  T  < 


(2.5) 


where  E  {  .  |  denotes  mathematical  expectation.  We  also  define  two  similar  power  constraints  on  the 
random  jamming  sequence  s*.  We  say  that  s*  satisfies  a  peak  jamming  power  constraint  (PJ)  if 


~  t  Pj  (a.s.)  (2.6) 


and  an  average  jamming  power  constraint  (AJ)  if 


E 


I  sr 
<  - 1 


<  Pj 


(2.7) 


There  are  two  input  power  constraints  (PI  or  AI)  and  two  jamming  power  constraints  ( PJ  or  AJ), 
and  so  there  are  four  possible  combinations  of  transmitter  and  jammer  power  constraints  to  consider. 
We  adopt  a  simple  binary  nomenclature  to  describe  each  case.  In  the  sequel,  when  we  speak  of  the 
GAVC  A  I  B,  we  mean  the  GAVC  with  input  power  constraint  A  (=  PI  or  AI),  and  jamming  power 
constraint  B  (=  PJ  or  AJ). 


We  now  specify  what  is  meant  by  the  "error  probability"  of  the  code  C*.  Given  a  code  C*  on  the 
GAVC  A  I  B  and  the  jamming  sequence  s*,  we  can  in  principle  calculate  the  (maximum)  probability  of 
error: 


uc;,s*) 


max  Pr  (  u*  +  tj*  +  s*  €  /)* )  , 


(2.8) 


where  D *  denotes  R"  -  D*  However,  s*  is  not  known  in  advance  to  the  transmitter  and  may  change 
from  one  block  to  the  next  in  an  unpredictable  and  arbitrary  way,  subject  only  to  the  power  constraint 
B.  The  smallest  error  probability  guaranteed  to  be  achievable  by  the  code  C*  is  the  supremum  of  Eq. 
(2  8)  over  all  B-admissible  s*  Therefore  we  define  the  error  probability  of  the  code  (  by 


\',J  ( c; )  =  sup  k  <  (•;.»• » 
o 


(2.9) 


where  the  supremum  is  performed  over  all  B-admissible  \* 
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We  now  ask.  For  a  given  source  rate  K  and  constraint  pair  A  |  B,  what  is  the  smallest  error 
probability,  X8  ( CJ ),  that  can  be  achieved  by  any  ( n,  M)  random  code  C*  that  satisfies  constraint  A, 
when  M  >  2nR  and  n  is  large?  Clearly  this  error  probability  depends  on  both  the  rate  R  and  the  con¬ 
straints  A  |  B.  Accordingly,  we  say  that  a  pair  (/?,  X),  where  R  ^  0  and  0  <  X  <  1,  is  achievable  Tor 
the  case  A  |  B  ( achievable  A  |  B)  if  for  all  t  >  0  there  exists,  for  all  n  sufficiently  large,  an  (n  ,  M)  ran¬ 
dom  code  C*  satisfying  constraint  A,  so  that 

log2  M  >  n(R  -  e)  (2.10) 

and 

Xfl  (CJ)  <  X  +  €  .  (2.11) 


Let  |  B  denote  the  set  of  all  achievable  pairs  ( R  ,X)  for  the  GAVC  A  |  B. 

Note  that  if  a  certain  pair  (/?,X)  is  achievable  A  l  B,  then  all  pairs  (/?’,X'),  such  that 
/?’</?  and  X'  >  X,  are  also  achievable  A  |  B.  Consequently,  \B  must  be  of  the  form 

R4,«  =  (  (R  ,X)  |0  <  C,,lfi(X),  0  <  X  <  1  }  (2.12) 

I 

t 

where  CA\B(\)  is  a  monotone  increasing  function  of  X.  Thus,  to  characterize  R^i#  it  suffices  to 
determine  C*  |  B  (X) . 

The  function  CA  \  B  (x)  is  called  the  X-capacity  of  the  channel  (cf.  Csiszar  and  Korner  [3]  and  Wol- 
fowitz  [2)).  It  can  be  interpreted  as  the  largest  rate  of  transmission  that  can  be  achieved  by  a  code  with 
error  probability  no  greater  than  X,  for  large  n.  If  CA\B  (X)  is  equal  to  a  constant  on  0  <  X  <  1,  say 
CA\B,  the  latter  is  called  the  capacity  of  the  channel;  otherwise,  if  CA\B  (x)  is  not  constant,  we  say  that 
no  capacity  exists  ?  Most  simple  channel  models  that  arise  in  information  theory  have  a  capacity.  In 
this  report,  we  show  that  certain  GAVCs  generally  have  no  capacity;  i.e.,  CA\B  (X)  is  not  constant.  This 
interesting  and  somewhat  surprising  fact  distinguishes  GAVCs  from  discrete  AVCs:  Blackwell,  Breiman, 
and  Thomasian  (1]  have  shown  that  the  latter  always  possess  a  (random  coding)  capacity. 

Recall  that  our  objective  is  to  determine  the  minimum  error  probability  suffered  by  large  block- 
length  random  codes  of  rate  R  when  used  on  the  GAVC  A  |  B.  Define  this  error  probability  by 

XA  1 8  (  R  )  =  limsup  inf  X*(CJJ),  (2.13) 

"  -  °°  ( 


where  the  infimum  is  over  all  A-admissible  ( n  ,  2"*)  random  codes.  It  is  easy  to  see  that  the  relation¬ 
ship  between  XA  1 B  (  R  )  and  CA  \  B  (x)  is 

X'"8  {R  )  -  min  (0  <  X<  1  I  1 0  (X)  >  R  or  X  -  1  )  .  (2.14) 

Although  it  clearly  provides  the  same  information  about  R^  \B  that  CA  \B  (X)  does,  X'4 18  (  R  )  is  often 
easier  to  interpret. 

We  now  present  four  theorems  that  characterize  CA  \B  (X)  for  each  pair  of  constraints  A  |  B,  the 
proofs  of  which  are  provided  in  the  next  section.  We  first  consider  the  case  in  which  both  transmitter 
and  jammer  are  constrained  in  peak  power,  i.e.,  the  GAVC  PI  I  PJ.  This  channel  actually  has  a  capacity 
that  is  given  by  the  following  familiar  formula. 


+  An  alternative  (e  g  Csiszar  and  Kdrner  (311  definition  of  capacity  (which  always  exists)  is 


Our  definition  is  that  of  Wolfowitz  (2) 


Q|S  =  lim  CA\„(k). 
»-o* 


-.'sr'S  V  .■ .  -  . ............ . .  «j 
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Theorem  1:  For  Che  GAVC  PI  I  PJ,  a  (random  coding)  capacity  exists  and  is  given  by 

Cpi  I HJ  (^)  =  Cpi  i  pj  =  7  log? 

for  all  0  <  X  <  1. 

Remark :  Blachman  (  (4),  p.  53,  Eq.  10)  states  (without  proof)  a  similar  result. 


1  + 


Nt  +  Pj 


(2.15) 


It  is  interesting  to  note  that  CP,  \  PJ  is  identical  to  the  capacity  formula  of  the  memoryless,  Gaus¬ 
sian  channel  that  would  be  formed  if  the  jammer  transmitted  a  sequence  of  i.i.d.  N  (0 ,Pj)  random  vari¬ 
ables  (eg.  Wolfowitz  (2l,  Theorem  9.2. l).tt  We  conclude,  for  the  GAVC  PI  |  PJ,  that  an  intelligent 
jammer,  regardless  of  how  he  distributes  his  power,  can  do  no  more  harm  (in  the  sense  of  reducing  the 
achievable  region)  than  Gaussian  noise  of  the  same  power. 

We  now  change  the  jamming  power  constraint  from  PJ  to  AJ  (i.e.,  GAVC  PI  I  AJ)  and  ask 
whether  the  above  conclusion  is  still  valid.  Since  bounds  on  average  power  are  weaker  than  those  on 
peak  power,  it  is  obvious  that  ^Pt\AJ  is  a  subset  of  R /»/ 1  />y •  However,  as  the  next  theorem  demon¬ 
strates,  this  inclusion  is  strict.  In  fact,  we  find,  for  this  and  all  remaining  cases  in  which  either 
transmitter  or  jammer  or  both  are  subject  to  average  power  constraints,  that  no  capacity  exists ,  i.e.,  only 
X-capacities  are  found. 


Theorem  2:  For  the  GAVC  with  constraints  PI  I  AJ  the  (random  coding)  X-capacity  is 


CPt\Aj(b)  -  y  log2 


1  + 


Ne  +  Pj  /  X 


(2.16) 


for  all  0  <  X  <  1. 

Remark.  CP/  \  AJ  (0)  is  interpreted  as  0. 

Observe  that  the  expression  for  CPt  \AJ  (x)  is  identical  to  that  of  CP,  \PJ  except  that  the  jamming 
power  appears  boosted  by  a  factor  that  is  the  reciprocal  of  the  tolerable  error  probability,  X.  Some 
insight  into  this  formula  can  be  gained  by  stating  the  result  in  terms  of  the  error  probability  suffered  by 
codes  of  rate  R.  Theorem  2  states  that,  for  increasing  n,  optimal  (n  ,  2"R)  random  codes  satisfying  PI 
suffer  an  error  probability  that  approaches 


Awl^(fi) = 


(4*  -  1  )Pj 
Pj  -  (4*  -  1)/V(. 
I, 


ft  ^  6  HI  I  AJ  ( 1 ) 
ft  <  CPj\aj  (1) 


(2.17) 


against  an  AJ-constrained  jammer. 

The  function  X Pl  1 AJ  ( R )  is  increasing,  positive  whenever  R  is  positive,  and  for  small  R  becomes 
asymptotic  to  2  In  2  ft  Pj  I  PT.  The  region  RP/\  AJ  is  sketched  in  Fig.  2.  Apparently,  a  code  can 
achieve  high  reliability  (i.e.,  kAj  (C*)  =  0)  only  in  the  limit  as  R  or  Pj  /  P,  become  vanishingly  small. 
Evidently,  reliable  communication  is  impossible  at  any  positive  source  rate. 


*ll  is  also  the  formula  obtained  by  Dobrushin  [7|  for  the  capacity  of  the  Gaussian  compound  channel. 

tNote  that  this  Gaussian  lamming  sequence  does  not  satisfy  PJ  It  is  possible,  however,  to  construct  a  lamming  sequence  that 
does  satisfy  PJ  and  that  yields  nearly  the  same  capacity  (cf  proof  of  Theorem  2) 
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Fig.  2  —  The  achievable  regions  for  GAVC  PI  I  PJ 
and  PI  |  AJ 


We  now  sketch  the  basic  idea  behind  Eq.  (2.17)  (or  equivalently,  Theorem  2);  a  detailed  proof 
follows  in  Section  3.  Let  C*  be  any  Pl-admissible  random  code  of  rate  R.  Suppose  the  jammer 
transmits  only  jamming  sequences  s*  consisting  of  i.i.d.  sequences  of  N  (0,  P* )  random  variables, 
where  P *  is  a  nonnegative  random  variable  that  satisfies  E P*  <  PJ%  so  that  s*  satisfies  AJ.  (Clearly, 
this  restriction  can  only  increase  the  achievable  region.)  With  this  restriction,  the  channel  “seen"  by  the 
transmitter  is  a  discrete-time,  Gaussian  channel  with  (unknown)  noise  power  Ne  +  P*.  According  to 
the  coding  theorem  and  strong  converse  for  this  channel  (e.g.  Wolfowitz  [2],  Theorems  9.2. 1-2),  if 

*  4  2  1081  I  '  +  nTTF 


and  n  is  large,  then  \AJ  ( C*  )  ~  0  is  possible;  however,  if 


then  KAJ  (  C*  )  =  1  is  certain.  The  jammer  must  therefore  choose 

P'  ^  (4*  -  1)  ~  Ne 

to  be  guaranteed  an  appreciable  error  probability,  and  this  power  is  sufficient  to  yield  an  error  probabil¬ 
ity  of  unity.  Therefore,  the  best  codes  have  error  probability  that  approximates  the  probability  of  this 


^AJ  (  C*  )  ~  Pr  P*>— -Nr 


Finally,  the  right-hand  expression  above  takes  on  a  maximum  value  of  k'^AJ(R)  when  P*  is  chosen 
so  that 

p 

Pr  P*  s=  - Nr  =  1  -  Pr  |  P*  =  0  !  =  A''' 1 AJ  (R )  . 

(4s  -  1  ) 


It  follows  that  \AJ  (  C* )  is  not  less  than  A ,v  1 AJ  (R)  for  large  n. 
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Although  we  have  allowed  the  jammer  foreknowledge  of  the  statistics  of  the  transmitter’s  random 
code  when  selecting  a  jamming  sequence  (cf.  Eq  (2  9)),  it  turns  out  that  this  knowledge  is  unneces¬ 
sary.  Remarkably,  the  jamming  sequence  above  does  not  depend  on  the  detailed  structure  of  the  code, 
but  only  on  the  blocklenglh  n,  the  source  rate  R,  and  the  parameters  Pt  ,  Pj ,  and  A,, .  Also  interesting 
is  that  this  jamming  sequence  is  essentially  a  pulsed  strategy  (i.e.,  either  "off'  or  "on"  with  high  peak 
power).  Memoryless,  pulsed  jamming  sequences  have  been  shown  to  maximize  the  error  probability  of 
certain  uncoded  modulation  systems,  such  as  BPSK  (e  g.  Simon  et  al.  [9]).  Theorem  2  shows  that 
pulsed  jamming  sequences  with  memory  play  a  similar  role  for  random  block  codes  on  the  GAVC. 

We  have  seen  from  Theorem  2  that  an  average-power-limited  jammer  has  a  tremendous  advan¬ 
tage  against  a  peak-power-limited  transmitter;  in  fact,  reliable  communication  is  impossible  in  this  case. 
It  is  interesting  to  turn  the  tables  and  ask  whether  the  transmitter  might  similarly  gain  by  varying  code¬ 
word  power  against  a  peak-power-limited  jammer,  as  in  the  case  AI  I  PJ.  The  next  theorem  shows  that 
little  advantage  will  be  gained. 

Theorem  3:  For  the  GAVC  with  constraints  Al  |  PJ,  the  (random  coding)  X-capacity  is 


I  Pj  /  ( 1  -  X ) 

<«/■/•;  <A)-y  log:  l  +  ~Nf  +  Pj 


(2.18) 


for  all  0  ^  X  <  1 . 

The  corresponding  achievable  region  is  sketched  in  Fig.  3.  We  see  that  if  a  high  error  probability 
can  be  tolerated,  the  allowable  coding  rate  is  much  improved,  however,  at  low  error  probabilities 
(■  41  rj  (X)  approaches  ('/>/  ,v,  and  the  improvements  are  negligible.  As  in  the  other  cases,  we  can  state 
the  result  in  terms  of  error  probabilities:  Optimal  Al-admissible  ( n,2nK )  random  codes  suffer  an  error 
probability  that,  for  large  n,  approaches 


X1'  ,J  (R)  = 


( 4*  -  1  )  (  A’,.  +  P,  ) 


R  <  C4/|,.7(0) 


•  R  >  C (0)  . 


(2.19) 


Thus  the  rates  at  which  reliable  communication  can  occur  are  the  same  as  the  case  PI  I  PJ.  Clearly, 
codeword  power  variation  offers  little  improvement  to  the  transmitter. 
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We  now  consider  the  GAVC  Ai  I  AJ.  As  Theorem  3  shows,  the  additional  flexibility  offered  by 
the  power  constraint  Al  is  relatively  useless  against  a  peak-power-limited  jammer.  We  now  ask  if  the 
transmitter  might  at  least  reduce  the  gain  of  the  average-power-limited  jammer  compared  with  the 
GAVC  PI  AJ.  The  next  theorem  shows  that  some  limited  improvement  is  made. 

Theorem  4:  For  the  GAVC  with  constraints  Al  !  AJ  the  (random  coding)  x-capacity,  for  N,.  >  0,  is 
given  by 


T  1o82  1  + 


log2  1  + 


N,  +  Pj/2k 

P7  (1  -  2X,) 
(1  -  X)  Ne 


,  0  ^  X  ^  Xt. 


xt.  <  X  <  1 


(2.20a) 


where 


and  in  the  case  Ne  =  0  by 


(-  Al  I  AJ  (X)  — 


y  log2  1  +  .  0  <  X  <  y 

1  '°8-  1  +  20  -I)  7,  'Ta<l 


(2.20b) 


Remark:  Equation  (2.20a)  tends  continuously  to  Eq.  (2.20b)  as  Ne  — *  0. 

The  corresponding  achievable  region  is  sketched  in  Fig.  4,  with  CP7\PJ,  CP7  \AJ  (X),  and  CA7 \PJ  (X) 
included  for  comparison.  Optimal  ( n,lnR )  random  codes  satisfying  Al  must  then,  as  n  grows  large, 
suffer  an  error  probability  that  approaches 


\AllAJ  (R) 


Pj  (4*  -  1) 

- d  ,  R  ^  A  l  l  AJ  Xr) 

2(Pt  -  (4*  -  \)Ne) 

Pi  (1  ~  2X,)  ,  . 

1 - ,  R  >  CAi\aj  (Xf) 

(4*  -  1 )  Nr  ' 


(2.21a) 


when  A’..  >  0,  and 


Pj  (4*  -  1) 


1  P7 

R  <  |  'og2  1  +  -D- 


XAI\AJ  {R)  _ 


PT  1  P7 

1 - - - ,  R  >  4  log2  1  +  — L 

2(4*  -  1  )Pj  2  62  Pj 


(2.21b) 


when  Ne  =  0. 


For  R  <  CA7\AJ  (xc),  observe  that  the  error  probability  is  half  of  that  of  GAVC  PI  i  AJ;  however, 
when  R  >  CA7  \  AJ  (X c )  the  probability  of  being  correct  (  =  1  —  \AJ  ( C*„ ) )  is  ( 1  —  2x,  )  of  that  in  the 
case  AI  I  PJ.  CA7tAJ  (x)  is  therefore  a  compromise  between  CPI  \AJ  (X)  and  CA7  \PJ(\).  As  in  the  case 
PI  AJ,  the  error  probability  can  be  made  small  only  by  making  R  or  Pj  /  P7  small. 
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tig  4  —  The  achievable  region  for  GAVC  Al  I  AJ  (with 
all  other  A -capacities  included  for  comparison) 


An  intuitive  justification  of  Eq.  (2.21a)  is  given  here  (a  rigorous  proof  is  given  in  Section  3). 
Suppose,  as  before,  the  jammer  transmits  only  i.i.d.  sequences  of  /V  (0,  P\)  random  variables,  say  s, 
where  P*  is  a  nonnegative  random  variable  that  satisfies  EPf  <  Pj._ The  transmitter  constructs  a  ran¬ 
dom  code  C*  in  the  following  way:  He  first  selects  a  random  code  C*  of  rate  R  whose  average  power 
is  no  greater  than  unity,  i.e.. 


E 


,*2 


<  1, 


and  then,  to  form  C*,  he  multiplies  each  codeword  in  C*  by  y/pj,  where  P\  is  an  independent  nonne¬ 
gative  random  variable  satisfying  E P*  <  PT.  The  performance  of  this  code  against  s*  is  a  function  of 
the  signal-to-noise  ratio  P*/  (P*+Ne).  As  in  the  earlier  argument  following  Theorem  2,  if 


p r 

p\  +  K  > 


(4*  —  1 ) , 


then  A  (  C*,s* )  can  be  small;  however,  if 


P'l  +  Nt 


(4*  -  1), 


then  it  is  certainly  true  that  A  (  C*,s*  )  =  1.  Therefore,  for  the  best  choice  of  C*,  we  have  for  large  n 

A(C;,s*)  =  Pr  (  Pf  <  (4R  -  1 )  (/>J+  Nt)  ) .  (2.22) 


The  optimum  error  probability  thus  depends  only  on  the  power  distribution  of  the  transmitter  and  jam¬ 
mer.  Naturally,  the  transmitter  wants  to  minimize  Eq.  (2.22)  with  an  appropriate  choice  of  Pf,  and  the 
jammer  wants  to  maximize  it  by  an  effective  choice  of  P*.  Therefore,  an  optimal  code  suffers  the  error 
probability 

a"<C’;>s=  max  min  Pr  {  Pf  <  (4*  -  1 )  ( P}  +  Ne  )  } . 

It  can  be  shown  (cf.  proof  of  Theorem  4)  that  the  right-hand  side  of  this  equation  is  equal  to 
A  a,]aj(R). 
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Finally,  consider  the  coding  problems  that  result  from  the  imposition  of  multiple  constraints.  Sup¬ 
pose  our  code  must  satisfy  some  constraint,  say  A ,  for  some  constant  PT,  and  another  constraint  A'  for 
some  constant  P;  ^  PT.  Denote  this  joint  constraint  by  AA '.  Similarly,  one  may  define  a  double  con¬ 
straint,  BB\  on  jamming  vectors.  It  is  easily  checked  that  the  achievable  regions  for  these  more  com¬ 
plex  coding  problems  can  be  constructed  from  the  regions  defined  by  Theorems  1  to  4  according  to  the 
following  simple  rules:+ 


R^'ls  —  |«  D 

R/l  I  BB  =  I  B  D  |  B‘ . 


(2.23a) 

(2.23b) 


L--‘y 

■.VV 


Hj>  *. 

vy,* 


Ay* 


or,  in  terms  of  A -capacities: 


Caa '  1  B  —  m‘n  t  I  s  (X)  ,  C a ' \  B  ( A ) 
Ca\bb  ( a)  =  max  {  CA  \B  (A),  CA  \B-  (A) ) 


(2.24a) 

(2.24b) 


3.  THE  PROOFS  OF  THEOREMS  1  TO  4: 

For  any  input  power  constraint  A,  and  jamming  power  constraint  B,  define  the  region 
R^Ib  =  (  (R  ,A)  |0  <  R  <  CA\B  (A),0  <  A  <  1  ), 

where  CA  \B  (A)  is  the  formula  given  in  the  theorem  of  Section  2  corresponding  to  the  constraints  A  |  B. 
Our  goal  in  this  section  is  to  prove  that 

R/4  IB  =  is  - 

for  each  pair  of  constraints  A  I  B.  Each  proof  will  consist  of  two  parts:  a  forward  part 

R/<  I  B  3  R/4  I  8  » 


and  a  strong  converse 


(b):  R 


A  I  B 


C  R 


<418’ 


At  this  point,  it  is  convenient  to  present  some  definitions  and  results  that  we  use  in  the  proofs 
below.  By  the  standard  (n  ,  M)  random  code ,  we  mean  a  random  code 


c\  s  !  (V*,,  A\) . (vV  A\)  |, 


(3.1) 


constructed  in  the  following  way. 

(1)  The  M  random  codewords,  |vf, . . . ,  v *M },  are  a  collection  of  mutually  independent, 
random  n-vectors,  each  of  which  is  uniformly  distributed  on  the  n-sphere  of  radius  ~fn  ; 
i.e.,  the  probability  that  v*  lies  within  a  certain  region  on  the  surface  of  this  ^-sphere  is 
proportional  to  the  surface  area  (or  equivalently,  solid  angle)  of  this  region. 

(2)  The  random  decoding  sets,  [A |,  are  defined  by  a  strict  minimum  Euclidean  distance 
rule,  viz.. 


a;  =  (  y  €  R " 1 1  y— v*|  <  |  y-v?  | ,  for  all  A*/,  1  ^  k  ^  M  ! 


(3.2) 


til  is  unknown  whether  the  region  RAA‘]  BH'  t;,n  *1C  '••mil.irly  decomposed 
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where  I  •  I  denotes  the  usual  Euclidian  norm  on  R".  If  a  tie  occurs,  the  receiver  draws  no 
conclusion  about  the  transmitted  message  (and  hence  an  error  occurs).! 

We  make  several  observations  about  the  random  code,  C*.  First,  the  codewords  of  C*  are  cleariy 
Pl-adm  ijible  for  Pr  —  1;  in  fact,  Eq.  (2.4)  is  satisfied  with  equality  (with  probability  one).  Second, 
since  all  codewords  have  equal  length  (or  power),  each  decoding  set  in  Eq.  (3.2)  is  a  "flat-sided"  cone 
with  vertex  at  the  origin.  It  follows  that  the  sets  [A* ],*{.  |  are  also  minimum  distance  decoding  sets  for 
every  codeword  set  of  the  form  (-/P  v yfP  v J,),  where  P  >  0.  Third,  Shannon  [10]  has  con¬ 
sidered  the  use  of  this  random  code  on  the  discrete-time,  additive  Gaussian  noise  channel  and  has 
obtained  the  following  result:  There  exists  functions,  say  K  (P,P)  and  ( R,P ),  both  positive  so  long  as 

R  =  -  log 2M  <  ~  log}  (1  +  P  ) ,  (3.3) 

n  2 


such  that* 


Pr{  JP  v?  +  Tj‘  €  A*  }  K  (R,P)  exp  |  -nE{R, P)  ) 


holds  for  all  1  ^  <  M  and  n  >  1,  where,  here  and  throughout  this  section,  -q *  denotes  a  vector  of 

i. i  d.  N  (0,1)  random  variables.  Furthermore,  K  (R,  P)  and  f  ( R,P )  can  be  selected  so  that 


(a)  K  ( •  ,P),  —  E  ( •  ,P)  are  increasing,  and 

(b)  K  (/?,  ),-£(/?,  )  are  decreasing 


(3.5a) 

(3.5b) 


for  all  R  and  P  satisfying  Eq.  (3.3).  Finally,  C *  has  the  useful  properties  summarized  in  the  following 
lemma  whose  proof  is  contained  in  Appendix  A. 

Lemma  1:  Let  C*  be  the  standard  random  code  (  Eq.  (3.1));  let  s  be  any  /i-vector,  and  let  /  and  /  be 
any  pair  of  real  numbers  satisfying  /  ^  >  0.  Let  u*  be  a  random  variable  that  is  uniformly  dis¬ 
tributed  on  the  unit  n-sphere,  and  that  is  independent  of  the  codewords  {v* . v  J,).  Then 

(a)  Pr  {vf+r>*  +  s€^f)  =  Pr  {  vf  +  v*  +  \  s  |w*  € 

(b)  Pr  |  vf  +  7,,*  +  lw*  6  A',)  <  Pr{v*+r)*  +  I  to*  £  A*}  . 

Remark  Lemma  1,  part  (a)  stales  that  Pr(v*-f-T)*  +  s€/4*}  depends  only  on  the  magnitude  of  s,  and 
not  on  its  orientation;  part  (b)  implies  that  it  is  an  increasing  function  of  this  magnitude. 

A  second  useful  lemma  is  given  below;  its  proof  is  contained  in  Appendix  B. 

Lemma  2:  Let  {tj*](“  i  be  a  sequence  of  i.i.d.  random  variables  with  common  marginal  distribution  N 
(0,1)  Then  for  all  0  ^  «  <  1, 


(a):  Pr 


I  vf  -  1 


;  Wc  mile  th.it  l he  decoding  sols  M'l,*!  |  may  be  suboplimal  (in  the  minimax  sense)  decision  regions  for  the  loss  functions 
\rJ  It  ’)  and  K4J  <(  ;  >  l  or  proving  coding  theorems  this  will  not  matter  in  the  forward  part  or  the  proofs  we  can  certainly 
bound  the  error  probability  of  the  optimal  decoders  above  by  that  obtained  using  suboplimal  decoding  sets,  in  the  converse  part, 
we  can  bound  the  worst -case  error  probability  below  by  that  obtained  using  (block)  pulsed.  Gaussian  jamming  signals,  for  which 
the  sets.  |  I,  |,  are  a  uniformly  most  powerful  decision  rule 

I  We  have  picsenlcd  Shannon's  restill  in  a  form  that  is  different  from  the  original  statement  in  Ref  10.  but  which  is  convenient 
lor  tlie  prools  ol  the  present  section  Our  lorm  can  be  obtained  from  Shannon's  "firm’  upper  bound  in  Ref  10  by  making  the 
substitution  indicated  in  the  lootnote  to  page  lb  ol  (iallagcr  III  I  and  simplifying  the  resulting  bound 
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for  all  n  ^  rtQ(e ),  where  n0(t)  is  a  bounded  function  of  t  alone,  andt 


(b):  Pr 


1  " 


I  vf  >  »  >  Pr[Tii>  11 


for  all  n  >  1. 

We  also  require  an  Arimoto-style  strong  converse  112)  for  the  discrete-time,  additive  Gaussian 
noise  channel  with  peak  input  power  constraint  and  the  average  probability  of  error  concept.  Let 

c*  =  |  (ur ,Df) . (uj<,  D*m  )  ) 


be  any  Pl-admissible  (n,  M)  random  code  with  Pj  =  P.  There  exist  functions,  say  K'(R ,  P)  and 
£'(/?,  A),  which  are  both  positive  whenever 

R  =  —  log,  M  >  i-log2  ( 1  +  A  ) ,  (3.6) 

n  2 


such  that 

—  T  Pr{  ur+  7,*€  D:\  >\  -  K'  (R  ,P)  exp  (  -nE'  (R,P)  )  (3.7) 

M  ,  -  i 

holds  for  all  n  >  1.  (Note  that  any  lower  bound  on  the  average  error  probability  is  a  fortiori  a  lower 
bound  to  the  maximum  probability  of  error.)  Furthermore.  K  '  (R,  P)  and  E'  ( R ,  P)  can  be  selected 
so  that 

(a)  A''  (  •,£),  -£'  ( •  ,£)  are  increasing,  and  (3.8a) 

(b)  A'  (R  ,  ),  -£'  (A,  • )  are  decreasing  (3.8b) 

for  all  R  and  P  that  satisfy  Eq.  (3.6).  The  proof  of  this  result  is  very  similar  to  the  derivation  in  Sec¬ 
tion  VI  of  Ref.  10,  we  therefore  omit  it. 

We  now  present  a  Lemma  that  forms  the  kernel  of  the  strong  converses  to  Theorems  3  and  4. 
This  Lemma  is  of  independent  interest  because  it  gives  a  tight  lower  bound  on  the  average  error  proba¬ 
bility  of  any  code  when  used  on  a  Gaussian  channel  in  terms  of  the  code’s  power  distribution. 

Define  for  any  u  =  ( t/j . u„  )  €  R"  the  quantity 

A  (u)  =  —  Y  uj,  (3.9) 

n  , 

and  for  any  random  code  CJ,  let  U*  (C*)  be  the  random  variable  that  is  uniformly  distributed  on  the 
set  (  u  * . u  *M  )  of  codewords  of  C* . 

Lemma  3:  Let  C*  be  any  (n,  M)  random  code  and  J*  be  any  nonnegative  random  variable  that  is 
independent  of  C*.  Then  for  all  e  >  0  the  following  holds: 

-77  y  M  u*+  V;  +  yfJ*Tt*  €  D*  ) 

>  Pr  {  P(U(C*n))  <  (4*-2<  -  1)  (  Ne  +  y ))  -  y„  («) ,  (3.10) 


+  By  the  Central  Limit  Theorem,  the  left-most  expression  in  Lemma  2(b)  approximates  1/2  for  large  n 
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where 

yn  U)  =  K'(R  -  e,4*  -  2«  -  1  )  exp  I  —nE'  (R  -  e, 4"  "  2‘  -  1  ) )  -  2"  "* .  (3.11) 

Remarks:.  Observe  that  y„  («)  depends  only  on  n,  «,  and  R  and  is  independent  of  the  random  code  and 
the  jamming  power.  Also,  for  all  «  >  0,  yn  («)  —  0  exponentially  fast. 

Proof  of  Lemma  3:  To  prove  the  lemma,  fix  «  >  0,  and  let  C„  =  { ( u  t ,  Df  (u  be  any 

realization  of  C*.  Define  the  set 

St(C„,J )  =  {  1  <  i  <  M  I  />(u,)  <  (4R  2‘-  1)0 V, +  J)},  (3.12) 

and  further  definet 

Nt(C„,J)  =  #S,  (C„,7).  (3.13) 

It  is  immediate  that 

E  I  N,  (CJ,y*)  }  =  M  Pr  (  P  (U*(C*) )  <  (4s  -  1)  (Ne  +  7*)  ).  (3.14) 


The  average  error  probability  of  that  subcode  of  C„  that  consists  of  those  codewords  with  indexes  in 
5,  (  C„,7 )  can  be  bounded  below  by  the  strong  converse  (cf.  Eq.  (3.7)  )  for  the  Gaussian  channel  t 

1 


v  (r  n  I  Pr  [  u*  3-  i)*  3-  yfl  i)*  €0*1  CJ-  Cj 

/VfVCn,Z7  nStU'KJ\ 

>  1  -  K'  (/?„,4«  '  2‘  -  1  )  exp  {  nE'  (/?„,  4*  '2‘  -  1  )  ) 


(3.15) 


provided  that 


R„ 


log 2(Nt(CK,J))  ^  n  , 

-  >  R  -  2e 

n 


In  particular,  the  following  holds  for  all  C„,  7,  «,  and  R:  § 


(3.16) 


1 


I 

I  €  S.  ((  , 


Pr  u  *  + 


+  77  r,*  €  D:  I  C!  =  C„  } 


^  (  1  -  *'</?„, 4*  2'  -  1)  exp  I 0?„,4s-2‘ -  1)  )  1|*„ | **  - «,  (/?„) 

-  Bn(R,e))  l|«j«^  «-.)(/?„),  (3.17) 


where 


O?  ,e  )  =  *'(/?-  «,4*  '2‘  -  1  )exp  {  -nE‘  (R  -  t,AR~u  -1)1- 


+  The  quantity  #  A  denotes  the  cardinality  of  the  set  A 
t  We  interpret  the  left-hand  expression  in  Eq  (3  151  as  zero  if  < („ . V )  =  0 
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The  last  step  above  is  a  consequence  of  Eqs.  (3.16)  and  (3.8a).  Using  Eq.  (3.17),  we  obtain  the  desired 
lower  bound  to  the  average  error  probability  of  Cn : 

~r  £  Mu*+t,;  +  >/7  v'  €  d:\C'„  =  C„  } 

M  ,  -  l 

>  T7  L  M  uf+  Ve  +  yfJ  r,*  6  D'\C'n  =  C„  ) 
m  ,€s,(c,.y» 


3*  (i - «,(/*,«))  if« 


A/ 


Nt(C„,J) 


M 

M 

NAC'J) 

M 

NAC„,J) 

M 


M 


1|R  |  R  >  R  -«| 


1|R,  I  R„  <  R  -«l 

-  B.  (*,«)-  2 

-  y»  («)  • 


(3.18) 


Averaging  Eq.  (3.18)  over  the  distributions  of  CJ  and  and  using  Eq.  (3.14),  we  obtain  Eq.  (3.10), 
completing  the  proof. 

Proof  of  Theorem  I : 

(a):  R pi  |  pj  3  R/v  |  PJ  . 

Let  R ,  nonnegative,  be  given  and  set  M„  =*l2"*J.t  Define  a  sequence  of  ( n ,  M„ )  random  codes,  say 
{C\)“  i.  in  the  following  way: 

c;-{(urMf) . I  ,  (3.19) 

where  u*  =  VT'  and  ( (v f,  -4 *),... ,  (yJ,^  I  is  the  standard  (w,  Mn )  random  code,  defined  in 

Eq.  (3.1).  It  is  easily  verified  that  C%  satisfies  PI  for  each  n  >  1.  We  further  claim  that  if 

R  ^  CPi\pj,  (3.20) 

then  there  is  a  positive  sequence  {y„  |^1|  such  that 

Aw(C;)<y.  (3.21) 

and  —  0  as  n  —  +  oo.  If  true,  this  would  clearly  imply  that  any  R, A)  in  R/-/|/v  is  achievable  PI  I  PJ, 
and  thus  prove  (a). 


+M  denotes  the  integer  such  that  *  -  I  <  »  <  < 
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To  establish  this  claim,  suppose  that  Eq.  (3.20)  is  true;  let  cu*  be  an  independent  random  variable 
that  is  uniformly  distributed  on  the  unit  n-sphere  and  define 


<r„  (/)  =  Pr[  uf  +  7)  *  +  /oj*  6  A*) 


(3.22) 


for  any  real  number  /  >  0.  (Clearly,  ir„  (•)  does  nor  depend  on  /.)  Let  s*  be  any  jamming  sequence 
that  satisfies  PJ;  i.e..  Is*  I  <  nP,,  with  probability  one.  The  error  probability  incurred  by  s*  can  be 
bounded  in  the  following  way: 


_  U>  (M  _ 

Pr{  u,*+  7)*  +  s*  6  Ecr,  (Is*  |)  <  <r„  (yfUFj)  . 


(3.23) 


The  justification  of  these  steps  is  as  follows:  (a)  is  a  consequence  of  Lemma  1(a)  and  the  definition  of 
u*,  (b)  results  from  PJ  and  Lemma  1(b).  Taking  the  supremum  of  Eq.  (3.23)  over  all 
1  <  (  <  M  and  s*  satisfying  PJ,  we  obtain  the  bound 


A"  (c;)  <  o-„  (JWj) . 


(3.24) 


It  only  remains  to  estimate  the  right-hand  expression  in  Eq.  (3.24);  this  is  easily  done  by  relating  it  to 
the  error  probability  for  the  ordinary  Gaussian  channel.  Let  yfPjr)*  denote  a  vector  of  i.i.d.  N(0,Pj) 
random  variables,  and  let  /  (■)  denote  the  probability  density  function  of  the  random  variable 
m *  =yJ~Pj  I  tj*  I  .  It  is  easy  to  show  that 


Pr  (  u*+  +  yfPj-q*  6  A!)  =  f~  r rn  (l)f(l)dl. 


(3.25) 


Using  Lemma  1(b)  again,  we  find 


,  nr,  ^  cr"(/)/  (l)dl  ^  Pr  I  u*  +  v%  +  y/FjV*  €  A*,  } 

<r„WnPj)  ^  r  $  „  i  |  ,1^.1  • 

I  ,_/(/)<//  Pr  \\v  \  >  W 


(3.26) 


We  now  invoke  Eq.  (3.4)  (compare  Eqs.  (3.20)  and  (3.3))  to  bound  the  numerator  of  Eq.  (3.26)  by 

K  (R,P\)  exp  |  -nE  (R  ,/>,)  )  (3.27) 

where 


Nr  +  Pj/  b 


(3.28) 


for  all  6  >  0.  From  Lemma  2(b),  we  know  that  the  denominator  of  Eq.  (3.26)  is  not  less  than  1/4; 
therefore,  combining  Eqs.  (3.26)  and  (3.24),  we  conclude  that 

Aw  (C'„)  <  4  K  (K.P,)  exp  (  -  nE  (R,Pt)  )  (3.29) 


for  all  n  >  1  The  right-hand  side  tends  to  zero  as  n 
the  forward  part  of  Theorem  1 . 

(b):R/>,  i  i’j  c  R/’/  i  rj  ■ 


+°°,  as  desired.  This  completes  the  proof  of 
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►> 


tv 


fit 

$ 

m 


Ife 


Let  «  >  0,  and  suppose  that  /?  >  CW|W  +  «.  We  claim  that  there  exists  a  positive  sequence  (yn)“_  , 
such  that 


xw(c;)  >  \-yn 


(3.30) 


is  satisfied  for  all  Pl-admissible  random  codes,  C*,  where  R  =  (l/n)log2  M,  and 

-y„  — •  0  as  n  —  +°°.  Clearly,  £b)  follows  from  Eq.  (3.30). 

To  prove  the  claim,  fix  e  >  0  and  take  8  >  0  small  enough  so  that 


Cp/ 1  pj  <  y  log2 


1  + 


N,  +  Py/d+S) 


<  Cpi  |  pj  +  €  ^  R  , 


(3  31) 


and  let  C*  =  { (u f,  Df) . (uJ/,DJy))  be  any  ( n ,  M )  random  code  satisfying  PI  If  the  jamming 

sequence  s*  were  i.i.d.  N  (0 ,Pj/(  1  +  8  ) )  random  variables,  then  by  Eq.  (3.7)  we  know  that 


max  Pr  {  u*  +  t)*  +  -J Pj/(\  +  8)  tj*  €  D* 

I  <  /  <  M 

>  \  -  K'  (K,P1+S)  exp  {  -nE'  (K./W  1 


(3  32) 


where  P(  )  is  as  defined  in  Eq.  (3.28).  Unfortunately,  -J Pjl(\  +  8)  tj *  does  not  satisfy  PJ.  therefore, 
we  define  a  truncated  noise  process  tj*(8)  as  follows: 


ij;(8)  = 


s/WT+~8)n* 

T^\V  ’ 


|tj*  I  <  s/nTT+  8) 
lrj*  I  JS  V/i  (1+8). 


inn 


so  that  tj*(8)  is  clearly  admissible  under  PJ.  Now 


Pr{  u*+V*e  +  y/Pj/l\  +  S)tj*  €  D*,  } 

-  Pr  (  ur+  v*  +  yJPJ/  (1  +  8)tj*  U*  I  <  v«(l  +  8)  )  X  Pr  1  It,*  I  ^  Jn  (1  +  8)  I 

+  Pr  {u:+v'e  +  yfPj/Tl  +  8)t»*  Itj*  I  >  V»(  1  +  8)  )  x  /V  {  |  tj  *  I  >  s/n  ( 1  +  8)  1 

<  Pr  {  u*+  tj*'+  ,*(8)  €  0*1  +  Pr  (  |  tj  *  !  >  fn  (1  +  8)  |  .  (3  34) 

From  Lemma  2(a),  the  right-most  expression  in  Eq.  (3.34)  is  bounded  above  by  exp  I  -«8:/12|  for 

all  n  ^  w0(8).  Taking  the  maximum  of  Eq.  (3.34)  over  all  i  and  substituting  Eq.  (3.32),  we  conclude 
that 


A PJ  (C*n)  >  max  Pr  {  u?  +  tj?  +  tj?(8)  €  D?  } 

l  ^  i  ^  M 

>  1  -  K'  (/?,P1+S)  exp  {  -  nE'  (/?,P1+S)  )  -exp  I  -  — ■  82  | . 


<3  35) 


12 


for  all  n  >  w0(8)  and  all  8  satisfying  Eq.  (3.31).  The  right-hand  expression  in  Eq.  (3.35)  tends  to  unity 
as  n  increases  uniformly  over  all  codes  of  rate  R ,  which  is  the  desired  result.  This  completes  the  proof 
of  the  strong  converse  to  Theorem  1. 
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Proof  of  Theorem  2: 

(a) :  R i>i  |  tj  3  I R/*/ 1  aj 

We  retain  the  notation  and  results  of  part  (a)  of  the  proof  of  Theorem  1.  Let  R,  nonnegative,  be 
given,  set  M„  =  \2',K\  ,  and  let  U  jlT-  i  be  tbe  sequence  of  Pl-admissible  ( n,M„ )  random  codes  intro¬ 
duced  in  Eq  (3.19).  We  claim  that  there  exists  a  positive  sequence  (yjT-  i  so  that 

kAi  (c  :>  <  KnUJ  (R)  +  y„  ,  (3.36) 


and  y„  — •  0;  this  implies  (a). 


To  prove  Eq.  (3.36),  let  s*  be  any  jamming  sequence  that  satisfies  AJ  and  let  A  be  such  that 
0  <  A  <  1 .  As  demonstrated  in  part  (a)  of  the  proof  of  Theorem  1  (cf.  Eq.  (3.29)),  if 


1 


R  <  y  'og2 


1  + 


Pi 


Ne  +  Pj/K 


-  G 


PI  I  AJ 


(X), 


(3.37) 


then  for  each  1  ^  <  M. 


Pr 


+  s*  €  /If  -  £  s*2  <  Pj/k 


<  4  K  (R,Pk)  exp  (  -nE(R,PK)  ), 


(3.38) 


where  P(  ,  ;s  defined  in  Eq.  (3.28).  Since  s*  satisfies  AJ,  Chebyshev's  inequality  (eg.  Ref.  13  )  yields 


Pr 


-  £  r  >  Pjt\ 


i  -  i 


<  X. 


(3.39) 


Using  Eqs  (3  38)  and  (3  39),  we  can  bound  above  the  error  probability  incurred  by  any  s*  satisfying 
AJ  in  the  following  way:  For  any  X  such  that  Eq.  (3.37)  holds,  we  have 


Pr  1  uf  +  7,(*  +  s*  €  A*  ) 


Pr 

[ur+T,P*  +  s*  €  A* 

1  X s*2  <  w 

"  1 

-  t  sV  <  Pj/k 

n  i 


+  Pr 


u  *  +  r)  *  +  s *  €  A* 


-  t 

"  I  -  l 


Pr 


-  I  >  Pj/k 

"  i  —  I 


<  X  +  4  A  (P,PA)  exp  (  -nE(R,P„)  )• 


(3.40) 


Let  (a„)„"'.  i  be  any  positive  sequence  such  that  A„  >  kPIAJ(R)  (so  that  Eq.  (3.37)  holds)  and 
k„  —  krl  4J  (R)  slowly  enough  so  that 


K  (R ,PK  )  exp  (  - nE  (R  ,PK)  |  —  0  . 


(3  41) 


Clearly,  such  a  sequence  exists.  Taking  the  suprcmum  of  Eq.  (3.40)  over  all  i  and  AJ-admissible  s* 
and  substituting  A„,  we  then  conclude  that 

kAj  (C'„)  <  A„  +  4  K  (R,P^)  exp  {  -nEiR.P^)  ).  (3.42) 


17 


HIK  IBS  AND  NARAYAN 


*'«!»* 

*W 

iW 

w 


& 

:s 


The  right-hand  side  of  Eq.  (3.42)  tends  to  kF‘]'AJ  (R)  as  n  increases,  proving  Eq.  (3.36)  and  (a).  This 
concludes  the  proof  of  the  forward  part  of  Theorem  2. 

(b):  R/>/ 1 AJ  C  R P,  1 4j  . 

We  now  prove  that  there  exists  a  positive  sequence  {>„!"_  i  so  that  —  0  as  «  —  »  and 

kAJ  (C*)  >  kF,lAJ  (R)  -  yn  (3.43) 

is  satisfied  for  all  Pl-admissible  (n,M)  random  codes,  where  R  =  (1  In)  log2A/,  (b)  follows  from  Eq. 
(3.43). 


First,  let  A  be  such  that  0  <  A  ^  1.  Suppose  that  a  "pulsed"  jamming  sequence,  say  s£,  is 
defined  to  be 


*r  =  JPjkZtn* 


(3.44) 


where  tj*  is  a  n -vector  of  i.i.d.  N  (0,1)  random  variables,  and  ZJ  is  a  Bernoulli  random  variable  that  is 
independent  of  t>*  and  distributed  as  follows: 


Mz;=  1}  =  1  —  /V  |ZJ  —  0)  —  A  . 


(3.45) 


It  is  easy  to  verify  that  s *  satisfies  AJ  for  all  0  <  A  ^  1  and  all  n  ^  1. 


Suppose  now  that  A  is  such  that 


*  >  yiosj  '  +  75pnyT 


Cpl\AJ  (A)  , 


(3.46) 


then  the  erro^  probability  of  C*„  can  be  bounded  below  in  the  following  way: 


kAJ  (C*n)  >  max  Pr  (  <  +  -q*  4-  s?€  D*  ) 

I  S?  i  $  M 


>»i 

& 

s 

w 

V 


5=  max  Pr  {  T,;  +  sj€  D?  Z\  -  l  1  Pr  |  Z\  -  1  I 

I  ^  i  <  M 


-  A  (  max  Pr  I  u  *  -t-  tj  *  +  -JPj/k  tj  *  6  £>*  )  ) 

I  S  i  <  M 


>  A  (  1  -  AC"  (R,Pk)  exp  {  -nE'  ( R,PK )  )  ) 


(3.47) 


where  P{  ,  is  defined  in  Eq  (3  28)  These  steps  are  justified  in  the  following  way:  (a)  is  an  immediate 
consequence  of  the  definition  of  k4J()  ;  (b)  follows  from  the  law  of  total  probability;  (c)  follows  from 
Eqs  (3  44)  and  <3  45).  and  (d)  is  a  consequence  of  Eqs.  (3.46)  and  (3.7). 


I 


Let  I A  J  |  be  any  positive  sequence  such  that  k„  <  k'nAJ(R)  (so  that  Eq  (3  46)  is  satisfied) 
and  A,  —  a'7  4J  (R)  slowly  enough  so  that 

K'  (R.Pk  )  exp  {  -  nE'  ( R  J\  )  |  —  0 


m 
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Substitution  of  X*  into  Eq.  (3.47)  yields 

X^(C;)  ^  X„  (  1  -  exp  (  —  nE\(R  ,-4^)  1  ) 

=  KP,UJ{R)  -  y,. 


(3.48) 


where  (-ynln0-  i  has  the  desired  properties.  This  completes  the  proof  of  the  strong  converse  to  Theorem 
2. 

Proof  of  Theorem  3: 

(a):  R^/ 1  pj  3  |  pj  . 

Let  R ,  nonnegative,  be  given  and  set  M„  =  12"*] .  For  any  0  <  X  <  1,  define  a  sequence  of 
random  codes,  say  (CJ(x)}”_  t,  in  the  following  way: 

CJ(X)  =  !  (uf(X),y«f> . (u Ah* )  ),  (3.49) 


where 

u  r(x)  =  y/pTn\-k)zi-kv?, 


(3.50) 


Z*_x  is  a  Bernoulli  random  variable  independent  of  r*  such  that 

Pr  {ZT-x  =  1>=1-  Pr|Z?-x  =  0}  =  1  -  X ,  (3.51) 


and  C *  =  ((vf,/lf) . (v*,,/!^)!  is  the  standard  (n,  M„)  random  code,  as  in  Eq.  (3.1).  It  is  easy 

to  verify  that  C*(\)  satisfies  Al  for  all  0  <  X  <  1,  and  all  n.  We  further  claim  that  there  exists  posi¬ 
tive  sequences  (xjT-  i  and  {>„}“-  i  such  that 

XW(C;(X„))  «$  kAnpj  (/?)  +  yn  (3.52) 

and  yn  —  0;  this  implies  (a). 


I 

1  The  proof  of  this  claim  is  in  the  spirit  as  the  converse  to  Theorem  2,  so  we  shall  be  brief. 

!  be  any  PJ-admissible  jamming  signal,  and  suppose  X  is  such  that 

i  R  <  CA,  |  pj  (x) . 


Let  s* 
(3.53) 


We  can  then  bound  the  error  probability  above  as  follows: 


,*(x)  + 

tj*  +  s*  €  At) 

=  Pr  1 

;  u  ,*(X)  +  tj  *  +  s*  6  a;\ 

o 

II 

-< 

* — 

N 

Pr 

o 

II 

■< 

• — 
N 

+  Pr  I 

!  U;(X)  +  Vr  +  s*  €  a;  1 

II 

#_ 

N 

Pr 

II 

•< 

*_ 

N 

<«> 

^  X  +  Pr  {  y/P,/(\-k)\*  +  7J?  +  S*  €  a;  | 


(/»> 

<  X  +  4  A' (/?,/’*)  exp  |  -  nE{R,PK)].  (3.54) 
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9 


$ 

A 

t«?r 

& 


where 

*V(i-x> 

/>x  =  - .  (3  S5 

/V,  +  Pj  ' 

The  justification  of  these  steps  is  as  follows:  (a)  results  when  Eq.  (3.51)  is  substituted  into  the  preced 
ing  equation,  and  the  first  conditional  probability  is  bounded  above  by  one;  (b)  follows  from  Eqs 
(3.53)  and  (3.29)  and  the  fact  tjiat  s*  satisfies  PJ. 

Now  let  (A„)“_  |  be  any  positive  sequence  such  that  A„  <  kpl  1 4J(R ),  A„  k1’1  l1J  (R),  and 

K  (RyPKn)  exp  {  -  nE(R,P *”)  !  -  0. 

Taking  the  supremum  of  Eq.  (3.54)  over  all  i  and  PJ-admissible  s*  and  substituting  A„,  we  find  that 

A PJ(C*(kn))  <  A„  +  4K(R<Pk")  exp  {  -  nE(R, PK")  | 

=  kA,lPJ(R)  +  yn,  (3.56) 


where  {yn  ,  has  the  desired  properties.  This  completes  the  proof  of  the  forward  part  of  Theorem  3. 
(b):  |  Pj  C  R  4/ 1  Pj  . 

We  now  prove  that  a  positive  sequence  lyJT-  i  exists,  which  depends  only  on  R,  so  that  yn  — ■  0  and 

kPJ  (C'„)  >  k4l]pJ(R)  -  y„  (3.57) 

is  satisfied  for  all  Al-admissible  ( n,M )  random  codes,  where  R  =  (M n)  log?  M\  this  implies  (b). 


To  prove  this,  let 


c;  =  {  ( u D'\) . <u \„Z>\,) 


be  any  Al-admissible  (nM)  random  code.  Fix  6  >  0,  and  let  tj*  (8)  be  the  PJ-admissible  jamming 
sequence  introduced  in  Eq.  (3.33).  As  in  part  (b)  of  the  proof  of  Theorem  2,  it  is  easy  to  show  that 


A  PJ  ( C* )  >  max  Pr  {  u  *  +  17  *  +  7?  *,  (8)  6  D,  j 


(3.58) 


^  |  max^  Pr  {  u  T  +  v  *  +  \JPjK  1  +  8)tj  *  <E  D,  j  -  exp  |  -  j . 

We  now  use  Lemma  3  to  lower  bound  the  first  expression  on  the  right-hand  side  of  Eq.  (3.58): 

max  Pr  u  *  +  r)  *  +  yfpjj  (I  +  8  )  ti  *  €  O, 

1  s,  «  s  \i  ' 

2*  jj  I  Pr  I  u:  +  T,;  +  JPj/(  1  +  8)tj*  6  d; I 

2*  Pr  (  P(U*(C:))  <  (4*  -  1)  (Nr  +  Pj/(  1  +  8))  )  -y„  (e>,  (3.59) 
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where  U'(  )  is  defined  jusl  prior  to  Lemma  3,  and  y„  (e)  is  as  defined  in  Eq.  (3  1 1 ).  Recall  the  defini¬ 
tion  of  A4/I,v(/?)  in  Eq.  (2.19);  when  we  want  to  exhibit  the  dependence  of  this  function  on  Pj,  we 
use  the  notation  K41 1  ,J (R \Pj) .  Since  C*  satisfies  Al,  it  is  true  that  E P(U(C'))  ^  Pt  Using  this 
and  Chebysheffs  inequality,  we  can  easily  show  that 

Pr  {  P{U*(C*))  <  (4*  -  2*  -1  )  (  Ne  +  Pj/(  1  +  6)  )  1 

>  KA,]HJ(R  -  2e-Pj/ (\  +  &))  .  (3.60) 


Therefore,  combining  Eqs.  (3.58),  (3.59),  and  (3.60),  we  conclude  that  for  all  «  >0  and  8  >  0, 


Aw  (CJ)  ^  \AllPJ  (R  -  2e-Pj/(  \  +  5) )  -  exp 


yn(«)  ■ 


(3.61) 


Note  that  the  right-hand  of  Eq.  (3.61)  depends  on  C*  only  through  the  rate  R.  Now  choose  (8„)“_  i 
both  depending  only  on  R  and  decreasing  to  zero  slowly  enough  so  that  the  last  two  terms  in  the  right- 
hand  of  Eq.  (3.61)  converge  to  zero.  The  right-hand  expression  then  tends  to  A A,'[FJ(R),  as  desired. 
This  completes  the  proof  of  the  strong  converse  to  Theorem  3. 

Proof  of  Theorem  4: 

(a):  Ra/ 1  aj  ^  Ra/ 1  aj  ■ 

For  any  nonnegative  R,  set  Mn  =  12"*!  .  Fix  e  >  0  and  define  a  sequence  of  Al-admissible 
(n,  M„)  random  codes,  say 

C'„U)  =  {  <uf(«Mf) . (u ^(e),/!^)  I  ,  (3.62) 


where 

u  *(e)  =  (3.63) 

P'U)  is  a  nonnegative  random  variable,  independent  of  v*  that  satisfies  EPqU)  ^  and  whose  dis¬ 
tribution  will  be  given  below;  and  C*  =  { ( v  i  is  the  standard  in,  Mn)  random  code.  It  is  easy 

to  verify  that  CJJU)  satisfies  AI  for  all  0  <  A  <  1,  and  all  n.  We  claim  that  there  are  positive 
sequences  |«  JT-  i  and  lynlT-  i  such  that 


\AJ  {C*n(tn))  <  A A,]AJ(R)  +  y„. 


(3.64) 


and  yn  —  0;  this  implies  (a). 

In  proving  this  claim,  we  assume  that  N,,  >  0;  the  proof  if  Ne  —  0  is  similar.  We  refer  the  reader 
to  the  Theorem  of  Appendix  C,  and  adopt  the  notation  used  there.  A  consequence  of  this  theorem  (cf. 
Eq.  (C'4)  )  is  that  if  A'n  has  the  distribution  Eq.  (C28b)  and  v0  is  as  defined  in  Eq.  (C28a),  then 

Pr  |  X0  >  Y  +  c]  >  v0  (3.65) 


holds  for  all  nonnegative  random  variables  E  that  satisfy  E  )  ^  ft. 


m 
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Now  make  the  following  substitutions: 


a  =  — 1 - ,  b  =  Pj,c  =  N, 

( 4*  *  _  i  > 


and  define  P*(t)  in  Eq.  (3.63)  by 


P*Je)  =  ( 4*  +*  -  1  )X0. 


With  these  substitutions,  it  is  easy  to  verify  that 

v0  =  1  -  A 41 UJ  (  R  +  «  ) . 

>  From  Eq  (3.65),  it  follows  that  if  7 *  is  any  nonnegative  random  variable  that  satisfies  E  7*  <  Pj , 
then 


Pr  |  P:,U)  <  (4Wt‘  -  1)  (  N,.  +  7*)  )  ^  kA,'AJ  (/?+e). 


(3.66) 


Let  s*  be  any  AJ-admissible  jamming  sequence  and  define  7*  =  [  s  *  | 2  (so  that  E7*  ^  =  Pj), 
and  set  s*  =  s */JJ*  when  7*  >  0  and  s’  =  0  otherwise  (so  that  |s*|<  1  a.s.).  In  the  proof  of 
Theorem  1  (cf.  Eq.  (3.29) )  we  showed  that  if  Is*  1  5$  1  a.s.  and  P  and  7  are  positive  constants,  then 


Pr  (  JP*U)v:+  T,(!  +  V7*l*€  A*  I  P*(«)  =  PJ*  =  7 


for  all  n  ^  1,  provided  that 


In  particular,  if 


<  4 A'  (A,P')  exp  !  -«£(/?, P')  ) , 


P’  =  P  —  >  (4*  -  I) 


(3.67) 


N,  +  7 


/V,  +  7 


>  (4*  —  1)  , 


then  using  Eq.  (3.5b)  we  can  further  upper  bound  the  right-hand  side  of  Eq.  (3.67)  by 
B„  ( A , « )  =  4  A  (A,4Rt<  -  I  )  exp  |  -  nE(RAKu  -  1  )  ). 

Note  that  B„  (A,«)  —0  for  all  «  >  0.  Now  define 


(3.68) 


(3.69) 


h„  (PJ)  = 


Bn  (A,«)  P  >  (4* *'  —  1)  ( N +  7) 


otherwise 


(3.70) 


so  that  hn(PJ)  is  an  upper  bound  on  Eq  (3.67)  /or  all  P .  7,  and  w.  Averaging  this  bound  over  the 
distributions  of  C  *(«)  and  7*,  we  find  that 

Pr  i  u r<« )  +  ri :  +  s*  a  a:  I  =  Pr  I  J~Pfi7)\:  +  r,;  +  Jr  s*  e  | 

^  e/»„  (  p,;<«),7* ) 


=  Bn  ( R.t )  +  (1  -  B„  ( A.t )  )  Pr  (  Prt(t)  ^  <4*  *  '  1)  (  N,.  +  7*) 

sS  Bn  (A,«)  +  (A  +  «  )  , 


(3.71) 


-\Wav.v. v.v;  .v.v  •• 


$ 
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7yT“, 


a 

yv 
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where  the  last  inequality  follows  from  Eq.  (3.66).  Taking  the  supremum  of  Eq.  (3.71)  over  all  i  and 
AJ-admissible  s*,  we  obtain  the  bound 


\AJ(C*„U))  <  Bn  (/?,«)  +  \A,UJ  (R  +e). 


(3.72) 


for  all  e  >  0,  n  The  claim  Eq.  (3.64)  now  follows  by  choosing  (e„}"_  ,  to  decrease  to  zero  slowly 

enough  so  that  B„  (/?,<„)  —  0;  since  \AI^AJ(  )  is  continuous,  the  right-hand  term  then  tends  to 
^ai\aj  (ft)  as  desired.  This  completes  the  proof  of  the  forward  part  of  Theorem  4. 

(b):  R,,  I  AJ  C  I  AJ  ■ 

We  now  prove  that  there  is  a  positive  sequence  {>-„}“=  [  that  depends  only  on  R,  so  that  y„  — *  0  and 

\AJ  (C'n)  >  \A,UJ(ft)-yn  (3.73) 

is  satisfied  for  any  Al-admissible  (n,  M)  random  code  C*,  where  R  =  (l/«)log2  M,  this  implies  (b). 

Fix  €  >  0.  As  in  part  (a)  of  the  proof  of  Theorem  4,  we  invoke  the  Theorem  of  Appendix  C. 
This  Theorem  implies  that  if  Y0  has  the  distribution  Eq.  (C28c),  and  v0  is  as  defined  in  Eq.  (C28a), 
then 

Pr{  X  >  K0  +  c  I  v0  (3.74) 

holds  for  all  nonnegative  random  variables  X  that  satisfy  Ef  ^  a.  Making  the  substitution 

Pi 


(4*-2«  _  i  ) 


,  b  =  Pj ,  c  =  N. , 


and  defining 


we  obtain  that 


and 


W  s  To. 

P *  =  (4*~2'  -  l)X  , 

v0=  |  -  x  (/?  -  2«) 


Pr  |  P'  <  (4*  2‘  —  I  )  (  N,  +  J$(f)  )  )  >  \  4J'AJ  (R  -  2e) 


holds  for  all  P'  satisfying 

EP'  P,  . 

Note  that  )rj *  is  Al-admissiblc  for  all  e  >  0. 


(3.75) 


(3.76) 


■s 
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Let  C‘  be  any  (n,  M)  random  code.  We  may  bound  the  error  probability  of  this  code  below  as 
follows: 

\AJ(C*)>  max  M  u;  +  v*  +  JWv*  e  d:\ 

\  ^  i  ^  M 

>  ~  I  +  e  d* } 

(a)  > 

>  Pr  {  P  (U*  (C*) )  <  (4s -  l)(Nr  +  yj(6))  )  ->„(«) 

(*) 

A'4,l/U(rt  -  2e)  -  (e),  (3.77) 


where  y„  (e)  is  defined  in  Eq.  (3.11).  The  justification  of  these  steps  is  as  follows:  (a)  results  by  apply¬ 
ing  Lemma  3;  (b)  follows  from  Eq.  (3.75)  and  the  fact  that  E P  (U*  (C*) )  <  PT.  Now  choose  a 
decreasing  sequence  of  positive  numbers,  {«„)“.  i,  such  that  e„  — *  0  slowly  enough  so  that 
y„  («„)  — »  0.  Substituting  e„  into  the  right-hand  side  of  Eq.  (3.77),  we  obtain  an  expression  that  tends 
to  \A,lAJ  (/?)  uniformly  for  all  Al-admissible  codes  of  rate  R ,  as  desired.  This  completes  the  proof  of 
the  strong  converse  to  Theorem  4. 


4.  DISCUSSION 

Our  results  show  that  the  asymptotic  behavior  of  GAVCs  is  qualitatively  different  from  that  of 
discrete  AVC:  whereas  the  latter  always  have  a  random  coding  capacity  (cf.  Blackwell  et  al.  Ill),  the 
former  generally  have  no  capacity  (except  in  the  case  PI  |  PJ).  This  is  a  direct  consequence  of  the 
imposition  of  power  constraints  of  the  average  type. 

It  remains  to  determine,  if  they  exist,  the  corresponding  A-capacities  for  the  GAVC  when  the 
transmitter  is  restricted  to  deterministic  codes  (i.e.,  those  of  the  form  Eq.  (2.2)).  For  the  discrete  AVC, 
deterministic  coding  capacities  are  known  in  many  special  cases.  Ahlswede  [14],  using  the  average  pro¬ 
bability  of  error  concept,  has  shown  that  the  capacity  of  the  discrete  AVC  is  either  equal  to  the  random 
coding  capacity,  or  else  it  is  zero.t  This  method  apparently  fails  for  the  GAVC,  owing  to  the  presence 
of  a  cost  structure  on  the  allowable  channels  and  encoders. 

The  coding  problems  of  Section  2  lend  themselves  to  an  alternative  game  theoretic  formulation. 
Corresponding  to  each  GAVC,  say  A  I  B,  there  is  a  family  of  two-player,  zero-sum  games  (cf.  Blackwell 
and  Girshik  [15])  defined  as  follows.  Fix  the  blocklength  n  and  the  source  rate  R.  The  transmitter’s 
(resp.  jammer’s)  allowable  strategies  consist  of  all  (n,  2nR)  random  codes,  C*  (resp.  all  R"  -valued  ran¬ 
dom  vectors,  s*)  that  satisfy  the  power  constraint  A  (resp.  B).  The  payoff  when  the  jammer  plays  s* 
and  the  transmitter  plays  CJ  is  the  error  probability  k(C*, s*),  defined  in  Eq.  (2.8).  The  jammer 
wants  to  maximize  this  probability;  the  transmitter  wants  to  minimize  it.  Therefore,  they  seek  stra¬ 
tegies  that  attain  the  outer  extrema  in  the  following  programs: 


Transmitter's  Program,  v.  =  inf  sup  A  (C*  s*), 

C"  ’’ 

Jammer's  Program :  v„  =  sup  inf  A  (C^,s*), 

S*  f  n 


(4.1a) 

(4.1b) 


where  the  extrema  are  taken  over  all  allowable  s*  and  C*.  An  optimal  strategy  for  the  transmitter  (resp. 
jammer),  if  it  exists,  is  one  that  attains  the  outer  extrema  in  the  transmitter's  (resp.  jammer's)  pro¬ 
gram.  For  any  €  >  Q.e-optimal  strategies ,  C*t  and  s*,  are  allowable  strategies  for  which 


sup  A  (C*,,s*)  ^  vn  +  e  , 


»• 


inf  A  (C*,s*)  ^  v„  -  «  , 


(4.2) 

(4.3) 


+  A(  present,  no  simple,  general  method  is  known  for  deciding  between  these  two  alternatives 
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i^l| 

jk*: 


•n 


where  the  extrema  are  taken  over  all  allowable  s*  and  C*.  It  is  always  true  that  vn  ^  v„ ;  if  v„  =  v„, 
then  the  game  is  said  to  have  a  value.  von  =  v„  -  v„. 

Equation  (4.1a)  defines  a  sequence  (in  n)  of  communications  games.  Basar  and  Wu  [6]  have 
considered  games  of  this  type  for  a  memoryless  Gaussian  source  and  for  a  different  cost  function,  viz., 
mean-square  distortion.  For  each  n,  they  obtain  the  value  of  the  game  and  characterize  saddle-point 
strategies  for  each  player.  In  contrast,  we  can  say  little  about  each  game  in  the  sequence,  we  can,  how¬ 
ever,  say  a  great  deal  about  the  asymptotic  behavior  of  the  sequence. 

Implicit  in  the  proofs  of  Theorems  1  to  4  is  the  following  result:  The  sequences 
(£„)”=  i  and  {vn |“=  [  converge,  and 

lim  v.  =  lim  v.  =  X/,lft(/?)  (4.4) 


holds  for  every  R  and  every  pair  of  constraints  A  I  B.  Thus  the  sequence  of  games  has  an  "asymptotic 
value"  equal  to  X^1  *(/?).  Furthermore,  for  all  e  >  0,  there  exists,  for  all  sufficiently  large  n,  «- 
optimal  strategies  for  both  transmitter  and  jammer.  (Such  strategies  for  the  transmitter  are  explicitly 
constructed  in  the  forward  parts  of  the  proofs  in  Section  3;  jamming  strategies  are  constructed  in  the 
converse  parts.) 

Some  authors  further  constrain  the  jammer  to  signals  of  the  form 

s*  =  (  zf-nf . z:  v*n),  (4.5) 

where  { -rj *} j'L i  is  i.i.d.  A(0,1)  and  ( zfl!L\  is  a  sequence  of  random  variables  independent  of  ( *} i  and 
subject  only  to  the  average  power  constraint 


^  £  z‘2  <  Pj 


We  call  this  constraint  AJG,  and  use  the  notation  GAVC  A  I  AJG  to  refer  to  the  channel  with  input 
constraint  A  and  jamming  power  constraint  AJG.  Since  AJG  is  more  restrictive  than  AJ,  we  must  have 
R-<  Iajo  D  R.-t  | aj-  However,  the  jamming  strategies  constructed  in  the  converses  to  Theorems  2  and  4 
are  all  of  the  form  Eq.  (4.5),  so  that  we  must  have  R4  \AJ(j  =  \AJ  and  consequently 

\A\ajo  {R)  =  ka\aj  {R)  (4.6) 

Thus  our  results  extend  to  Gaussian  jammers. 

It  is  especially  interesting  that  the  achievable  regions  of  Theorems  2  to  4  are  not  determined 
solely  by  a  simple  optimization  program  involving  mutual  information,  as  is  usually  the  case  in  informa¬ 
tion  theory.  McEliece  and  Stark  [8]  have  modeled  the  conflict  between  transmitter  and  jammer,  when 
coding  is  used,  by  a  two-player,  zero-sum  game  with  mutual  information  as  the  payoff  function.  As  an 
example,  they  considered  the  channel  that  we  have  called  the  GAVC  Al  |  AJ  (for  the  special  case 
Ne  =  0)  and  obtained  the  following  results:  Optimal  transmission  strategies  for  both  players  are  i.i.d 
Gaussian  sequences  of  maximum  power  and  of  length  n ,  and  the  value  (or  optimal  payoff)  is 

n  *  ft 
2  1061  l+f“ 
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If  the  value  of  the  game  considered  by  McEliece-Stark  is  actually  the  capacity  of  the  channel  (the 
authors  do  not  assert  that  it  is),  then  it  carries  the  following  interpretation:  when  n  is  large  and 

1  Pt 

R  <  J  loS2  1  + 

then  kAJ  (C*)  =  0  is  possible.  In  contrast,  however,  note  that  the  e-optimal  strategies  for  the  game 
AI  |  AJ  in  Eq.  (4.1a)  (cf.  proof  of  Theorem  4)  are  not  memory  less,  and  the  error  probability  of  any 
positive  rate  code  is  bounded  away  from  zero.  It  is  of  considerable  interest  that  these  two  apparently 
related  games  lead  to  such  different  results. 

An  explanation  of  this  disparity  between  predictions  of  these  two  games  lies  in  the  fact  that 
mutual  information  takes  on  operational  significance  only  when  the  block  length  is  large  compared  to 
the  memory  of  the  channel.  The  error  probability  formulation  (i.e.,  Eq.  (4.1a))  allows  the  jamming 
memory  to  equal  the  blocklength,  whereas  the  mutual  information  formulation  always  assumes  that  the 
blocklength  of  the  code  is  large  compared  to  the  jamming  memory.  Therefore  the  game  involving 
mutual  information  gives  an  a  priori  advantage  to  the  transmitter,  and  it  is  not  surprising  that  this 
approach  leads  to  much  more  optimistic  results  for  the  transmitter.  We  conclude  that,  at  least  for 
GAVCs,  one  must  be  careful  in  attributing  a  coding  significance  to  games  having  mutual  information  as 
a  payoff  function. 

From  a  practical  viewpoint,  the  results  of  this  report  may  be  difficult  to  achieve  or  may  lack 
meaning  for  a  real  jammer.  Like  the  pulse -jamming  signals  considered  by  Houston  [16],  our  e-optimal 
strategies  demand  high  peak  power  when  R  is  small;  unlike  Houston's,  however,  this  peak  power  must 
be  sustained  over  the  blocklength  of  the  code.  When  n  is  large,  the  average  power  constraints  (Al, 
AJ)  may  fail  to  reflect  all  the  physical  constraints  that  would  limit  a  practical  system.  An  extreme 
example:  let  n  —  +°a,  then  the  optimal  jamming  strategy  for  the  case  PI  |  AJ  is  of  the  form. 
s*  —  N  (0 ,/y/p)  for  all  time  with  probability  p,  and  s,  =  0  for  all  time  with  probability  1  -  p.  One  may 
approach  a  more  realistic  situation  by  considering  multiple  constraints  on  the  jammer  (as  discussed  in 
Section  2). 
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Appendix  A 


Proof  of  Lemma  1:  To  prove  Lemma  1(a),  let  s  and  to*  be  as  in  the  statement  of  the  lemma,  let  be 
any  unit  vector  in  Rn-  and  let  T  be  any  orthogonal  transformation  on  R"  that  maps  s  into  Is  |<u,  i.e.,  so 
that 

T  s  =  I  s  1 01 . 

Since  minimum  distance  decoding  is  used  (and  distances  are  preserved  by  D,  the  following  holds 
almost  surely: 

Pr{  vf  +  v*  +s€  Af)  =  Pr{  Tv  f  +  T  t)*e  +  |s|a>  €  TAl)  . 

The  sets  {  TAflft  ,  remain  minimum  distance  decoding  sets  for  the  codewords  I  Tv*},*!  ,  and  are 
spherically  symmetric,  and  so  are  unchanged  by  T.  We  conclude  that 

Pr{  vf+  -  Pr{  vf+ij?  +  |s|a»  €  If), 

for  all  w  in  the  ensemble  of  u>*,  from  which  Lemma  1(a)  immediately  follows. 

We  now  prove  (b).  Let  the  random  variable  m’be  defined  by 

and  let  F,(m)  be  its  distribution  function.  It  is  easy  to  verify  that,  conditioned  on  the  occurrence 
m,*  =  m,  the  expression  tj*  +  /<o*  is  uniformly  distributed  on  the  n-sphere  of  radius  m\  hence,  its 
conditional  distribution  does  not  depend  on  /.  Therefore,  define  the  quantity 

y(m)  =  Pr  [  u*  +  Tf*  +  I  to  €  A*  \  |tj*  +  /oj*  |  =  m  ).  ( A 1 ) 

Since  A*,  is  a  set  formed  by  the  minimum  distance  rule,  if  m  <  m  then 

t ?;  +  /«* 

uf  +  m  — -  €  AT 

m? 

implies 

.  .  T )*e  +  lto* 

uf  +  m  — — -  6  A\ 

ml 

and  consequently,  y()  is  monotone  increasing.  If  for  each  m,F^m)  is  monotone  decreasing  as  a 
function  of  /,  then 


y(m)  dF )  (m)  <  y(m)  dFt  (m) 


which,  according  to  Eq.  (Al),  is  simply  Lemma  Kb)  disguised  in  different  notation.  It  therefore  only 
remains  to  show  that 

Pr{  |  v:  +  Ito*  i  <  m  )  Pr{  \  v)*e  +  lw*  |  <  m  }.  (A2) 


»'  'd.,14  V  '*.  >  ,«VA  >  :'! 


**¥>  f  * 
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We  shall,  in  fact,  prove  a  stronger  result  that  implies  Eq.  (A2): 

Pr  {  |  t)?  +  /w*  I2  <  m2  I  w*  =  a>  )  <  Pr{  |  +  /<o*  |2  <  m2  I  <*>*  =  a»  ) 

for  all  a).  The  latter  inequality  is  an  immediate  consequence  of  the  fact  that  the  distribution  of  r/* 
decreases  monotonically  and  symmetrically  with  distance  from  the  origin.  This  completes  the  proof  of 
part  (b),  and  Lemma  1. 


ft 

sjr 


Appendix  B 


Proof  of  Lemma  2:  Let  {17*  }°°_  \  be  an  i.i.d  N  (0,1)  sequence.  To  prove  Lemma  2(a),  note  that  2(a)  is 
trivially  true  when  «  >  0,  therefore  take  «  >  0.  We  apply  Chernoffs  bounding  technique  (eg. 
Wozencraft  and  Jacobs  [Bl],  Section  2.5)  to  obtain  the  following  bounds: 


1  ^ 


Pr  {  -  L  v?  >  1  + «  <  [  e_</2 


1-1 


=  exp 


(Bl) 


—  (In  (l+«)  —  e  ) 


Pr 


<  [^/^7e,/2 1" 


(B2) 


=  exp 


-r  ( In  (1  -  e)  +  e) 


We  now  make  use  of  a  well-known  (e.g.  Olmstead  lB2])  expansion  for  In  (  1  +  x  ): 

ln(l+x)  =  x-  4  +  ‘T'  +  dt ,  -1  <  x  1  . 

2  3  Jo  1  +  t 


(B3) 


Let  us  use  Eq.  (B3)  to  derive  approximations  to  the  expressions  that  appear  in  the  exponents  of  Eqs. 
(Bl)  and  (B2);  viz., 


In  ( 1  +  e )  —  €  =  — ~ 

f2  c2 

<  -i-  +  *_=_«_ 
2  3  2 


_  r  11 
Jo  \  +  I 


'-T 


dt 


(B4) 


In  (  1  -  e  )  + 


=  -4-4-  S'—* 

2  3  Jo  l-t 


(B5) 


,  -  — 

2  3  2  3 


Substituting  these  approximations  into  Eqs.  (Bl)  and  (B2),  wc  obtain 


Pr 


-It,!2-  1 


=  Pr 


n 
\  1 

1  +*  |+  Pr  I  -j>  *,2^  1  - 


(B6) 


1-1 


^  2  exp 


n  €‘ 


2e 


I) 


<=l 


1  -  —  |  }  ^  exp 


n 

12 


The  last  inequality  holds  for  all  n  larger  than  n0(f)  =  bln  2/e2(  1  -  e  ),  which  depends  only  on  e.  This 
completes  the  proof  of  Lemma  2(a). 
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We  now  prove  Lemma  2(b).  For  n  =  1  and  2,  by  direct  calculation  we  obtain 

Pr{  7)*,2  S*  1  )  =  0.3174, 


Pr  1  ^  £  t}*,2  >  1  =  p-1  -  0.3679 


$] 

fell 

*T 


•ft 

y 


so  that  Lemma  2(b)  holds  for  these  values  of  n.  For  n  ^  3,  we  proceed  as  follows: 


II  n  I  (a)  -oo  (n-2>/2 --a/2 

1  =  /  - - - -  da 

1  "  7nnr  n 

2 


where 


(»>  n(n-2)/2  e-n/2  -  »  a<n-4>/2  p-a/2 

=  -  +  J  - 1 - </a 

jin- 21/2  r-  _H_  M<<-71/7  p  I  7?  2 

2  I  2 

(<•>  fln-2  ) 

=  M  — T  2>*J^  1  +e-' 


n(n-2)/2e-n/2 


2(n-2)/2p 

2 


;*  n  a(n-4)/2  ^-a/2 

-  da 

n  —  2 

2<"-2)/2  p 

2 


These  steps  are  justified  in  the  following  way:  (a)  follows  from  the  observation  that  £  r)*2  has  the 

i  -  i 

standard  chi-square  density  with  n  degrees  of  freedom  (cf.  (B3l);  (b)  follows  from  (a)  by  using 
integration  by  parts;  and  (c)  is  merely  a  rearrangement  of  (b). 

We  now  claim  that  «„  >  0  for  all  n  ^  3.  If  true,  this  together  with  Eq.  (B9),  (B7),  and  (B8) 
would  imply  (b).  To  prove  this  claim,  bound  the  integral  in  Eq.  (BIO)  as  follows. 

-n  -.(<1-41/2  „-a/2  (a)  _«/2_-<i/2  -  ft  1  1  "/2  . 


2<«-2>/2p 


aa 

1 

„ _ ") 

2<ff-2)/2  p 

n  l 

2 

2 

/•  n 

l  1 

i 

( 

•  n-2 

Him 

(/>)  n/2  -n/2 

<  - " - 

2  ( n  —  2)/2  p  71 


f"  djL 

Jn- 2 


(<  )  n(n-2)/2  e-n/2 


2 1 «  —  2)/2  p  I  _7t  I 


Equation  (a)  is  simply  a  rearrangement  of  factors;  (b)  follows  by  observing  that  the  bracketed  expres¬ 
sion  is  strictly  less  than  one  when  »/ n  <  I;  (c)  results  when  the  integral  in  (b)  is  evaluated.  This 
completes  the  proof  of  the  claim  and  Lemma  2. 


Appendix  C 


In  this  appendix,  we  study  the  following  two-player,  zero-sum  game  (cf.  Blackwell  and  Girshik 
(Cl]).  Let  a,  b,  and  c  be  real  numbers  such  that  a,  b  >  0  and  c  ^  0.  Player  l’s  (respectively,  player 
II’s)  allowable  strategies  consist  of  all  nonnegative,  real-valued,  random  variables  X  (resp.  Y)  satisfying 
EX  <  a  (resp.  EY  ^  b  ).*  The  payoff  to  player  I,  when  1  plays  X  and  M  plays  Y ,  is 

Pr[X  Y  +  c).  (Cl) 


Player  1  wishes  to  maximize  Eq.  (Cl);  player  II  wants  to  minimize  it.  Therefore,  I  and  II  seek  stra¬ 
tegies  that  attain  the  outer  extrema  in  the  programs 

Program  /:  v  =  sup  inf  Pr  {  X  ^  Y  +  c ) ,  (C2a) 

x  ex  >:£> 

Program  II  :  v  =  inf  sup  Pr  ( X  ^  Y  +  c ) .  (C3a) 

Y  E)  <6  X'EX  $  a 

If  a  strategy  exists  that  attains  the  outer  extrema  for  Program  I  (resp.  ID,  it  is  called  an  optimal  strategy 
for  player  I  (resp.  II).  It  is  always  true  that  v  >  v\  if  v  -  »»,  then  the  game  is  said  to  have  a  value , 
vo  =  v  “  E-  A  saddle-point  solution  to  this  game  (if  it  exists)  is  a  pair  of  allowable  strategies,  say 
(T0,  L0),  such  that 

Pr[X  >  Y0  +  c  }  <  Pr  (  X0  >  Y0  +  c  }  <  Pr  {  X0  >  Y  +  c)  (C4) 


is  satisfied  for  all  allowable  ( X ,  Y).  The  existence  of  a  saddle-point  is  a  sufficient  condition  for  a  value 
to  exist;  in  this  case  we  have 

v0  «  „  =  „  -  Pr  {  X0  >  T0  +  c  )  (C5) 


and  thus  X0  (resp.  T0)  is  an  optimal  strategy  for  player  I  (resp.  player  II). 

In  this  appendix,  we  derive  a  unique  saddle-point  solution  to  Eq.  (C3a).  The  special  case 
a  =  b  =  1,  e  =  0,  has  been  studied  by  Bell  and  Cover  [C2]  in  connection  with  competitive  investment, 
and  the  special  case  c  =  0  has  been  studied  by  McEliece  and  Rodemich  [C3]  as  part  of  a  study  of 
optimal  jamming  of  uncoded  MFSK.  We  construct  the  general  solution  of  Eq.  (C2a)  from  the  known 
solution  in  the  special  case  c  =  0.  Without  many  of  the  complications  that  arise  in  the  MFSK  problem 
studied  in  Ref.  C3  this  special  case  admits  a  proof  that  is  much  simpler  than  that  given  in  Ref.  C3;  we 
present  this  below. 


Lemma  1:  (Bell-Cover-McEliece-Rodemich)  Consider  the  two-player,  zero-sum  game  given  by  Eq. 
(C3a)  when  c  =  0.  This  game  has  a  value  v0  and  unique  saddle-point  strategies  X0  ~  F0  and  T0  ~  G0 
These  are  given,  in  the  case  a  ^  b,  byt 


G0U) 


E0(x)  =  G|0.2o]  (x)  , 


(AtUal  (■*)  + 


A0(x) ; 


(C6a) 

(C6b) 

(C6c) 


In  this  appendix,  we  abandon  the  convention,  used  earlier  in  the  report,  that  distinguishes  random  variables  with  asterisks 
^Throughout  this  appendix  we  use  the  following  notation:  X  —  f  means  that  the  real-valued  random  variable  X  has  distribution 
function  F  We  denote  by  U |a  *|<*)  the  distribution  function  of  a  random  variable  that  is  uniformly  distributed  on  the  interval 
[a. 6),  and  we  denote  by  &r  ( jr )  the  distribution  function  of  (he  trivial  random  variable  X  =  c 
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(C6d) 
(C6e) 

G0(x)  =  Ul0.2t>)(x).  (C6f) 

Remark :  The  proof  given  here  is  a  generalization  of  Bell  and  Cover’s  [C2] . 

Proof.  Let  X  —  F  and  Y  —  G  be  any  allowable  strategies.  Observe  that 

Pr(X  Z  Y  |  =  f“  G(x)dF(x)  =  1  -  f°°  F  (x-)  dG  (x)  .  (C7) 

•J  0  •'O 


and,  if  a  <  b,  are  given  by 


a 

V°~  2b' 


F0(x)  = 


V 


10,261 


(x)  + 


l-S- 


A0(x) 


First  consider  the  case  a  ^  b  Let  us  show  that  (T0,  Y0)  satisfies  Eq.  (C4)  when  c  =  0.  Using  the 
obvious  inequality  t/«» ,j\  (x)  ^  x/  d  when  x  ^  0,  we  then  obtain 

Pr{  X  >  K0I  =  Jo”  Go  (x)  dF  (x) 

b 


1-  * 
a 


i--* 

a 


+  ~  /0  V{0Ja\  <*F(x) 

+  -K  X  dF  (x) 

Jo 


^  1  U 


(C8) 


In  much  the  same  way,  using  the  right-most  equality  in  Eq.  (C7),  we  can  show 

Pr[X o  >  y)  >  v0. 


(C9) 


Since  Pr  \  X 0  ^  To  I  =  vo-  we  conclude  that  (T0,  K0)  is  a  saddle-point  and  v0  is  the  value  of  the  game. 

To  complete  the  proof  in  the  case  a  ^  b,  it  only  remains  to  show  the  uniqueness  of  F0  and  G0 
First  consider  G0  Let  Kd  ~  G'd  be  any  other  random  variable  such  that  £Td  ^  b  and 

Pr\x  >  n;l  ^  V0,  (CIO) 


for  all  admissible  X  Substitution  of 
(1):  X  -  U\0  2a\  (x). 


(2):  X 


a+(i 


(x)  + 


a+0 


(x)  , 


for  all  0  <  a,(i  <  a,  into  Eq  (CIO)  yields,  respectively 
( 1 ) :  Gq  (2a)  =  I  , 


(2): 


a+/3 


Gq  (a— a)  + 


a+/3 


Gd  (  a+l 3)  <  v0, 


for  all  0  <  a,P  ^  a. 
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We  claim  that  (2)  implies  that  there  is  a  line,  say  /(x),  that  passes  through  the  point  ( a ,  v0)  and  is 
such  that 

Gd(x)</(x),  (Cl  1) 


for  all  x  >  0.  To  prove  this  claim,  define* 


fi  =  max 

<K/3^a 


Go  (a +/3)  —  v0 

0 


<  +oo 


(C12) 


and  let  0  attain  the  maxima.  Let  /(x)  be  the  line  through  (o,v0)  having  slope  /*.  We  know  that 
Gq  (a)  ^  v0  =  /  (a)  (proof,  take  a  =  0  =  0  in  (2))._  By  construction,  /  (x)  satisfies  Eq.  (C 11)  when 
x  ^  a,  and  passes  through  the  point  (a+/ 3,  Go  ( a  +  (3)).  Now  if 

Gq  (a  —  a)  >  I  (a— a) ,  (C13) 


for  some  0  <  a  <  a,  then  a  and  0  violate  (2).  Therefore,  to  avoid  a  contradiction,  /  (x)  must  satisfy 
Eq.  (Cl  1 )  for  0  <  x  <  a  as  well,  proving  the  claim. 

We  now  show  that  Eq.  (C 11)  implies  that  Go  =  G0.  For  any  measurable  function,  say  fix),  let 
v,  denote  the  Lebesgue  volume  of  the  region  in  R2  comprising  the  points 
Rf  —  {  (x,.y)  |  0  <  x  <  2a,  /  (x)  <  y  <  1  ).  By  an  elementary  fact  of  probability  theory  and  (1),  we 
know  that 

„6.  =  £Ko  <  *  ■  (C14) 


Equation  (C 11)  implies  that  v0.  >  vh  and  hence 

v,  <  b.  (CIS) 


Since  /( 0)^  Gd  (0)  ^  0,  l  (2a)  >  Go  (2a)  =  1  and  1(a)  =  v0>  0,  is  a  triangular  region  and  /  (0) 


must  be  such  that  0  <  /  (0)  <  2  v0  -  1 . 


By  elementary  geometry,  we  can  show  that 
a  ( 1  -  /  (0)  )2 


‘'l  = 


2  (  v0  -  /  (0) ) 


(C16) 


for  all  0  <  /  (0)  <  2v0  —  1.  It  is  easy  to  show  that  Eq.  (C16)  is  a  strictly  decreasing  function  of  /  (0) 
that  attains  a  minimum  value  of  v,  -  b  when  1(0)  =  2v0-  1  .  Therefore  the  only  line,  /  (x ) ,  that 
passes  through  (a,  v0)  and  that  does  not  contradict  Eq.  (C15)  satisfies  /  (0)  =  2v0  -  1,  and  hence 


l(x) 


(Cl  7) 


Comparing  Eq.  ( C'  1 7 )  with  Eq.  (C6c),  we  see  that  /  equals  G„  for  all  x  such  lhal 
0  <  x  $  2 a  and  0  <  /  (x )  ^  1.  It  follows  from  Eq.  (Cll),  the  nonnegativity  of  K,i  and  K„,  and  (I), 
that 


G'd  (x)  <  G0(x) 


for  all  real  x.  This  implies  that  G,\  =  G„,  since  if  G,',  (x)  <  G„(x)  for  some  0  <  x  <  2a  ,  then 

f-  e;  =  r,,-  >  =  b , 


the  m.n  in  l.q  ((  12)  is  lusldied  bec.iuse  tr^j j  («*/ i)  i||)//i  is  upper  scmicontinunus.  mil  the  ripht  h.inil  mcipi.iliU  hcc.iuse 

this  function  is  hounded  by  i ,,/a  (to  prove  t.ike  n  -  a  in  (21) 
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a  contradiction.  We  conclude  that,  in  the  case  a  ^  b,  G0  is  unique.  The  proof  that  F0  is  unique,  and 
the  proofs  for  the  case  a  <  by  are  similar.  This  completes  the  proof  of  Lemma  1.  • 

We  now  consider  the  game  Eq.  (C2a)  when  c  >  0,  and  show  that  the  solution  in  this  case  can  be 
constructed  from  the  known  solution  for  the  case  c  =  0.  To  see  this,  note  that  any  nonnegative 
X  —  F  that  satisfies  EX  ^  a  can  be  decomposed  in  the  following  way: 


c  +  Z 


w.p.  1  —  p 


where  p  —  1  -  F  (c— )  and  W  ~  L  and  Z  —  H  are  nonnegative  real- -alued  random  variables.  The 
distribution  functions  L  and  H  are  given  by 


Fix) 

L  ix)  =  F(c-) 


if  Fie—)  >  0,  otherwise  L  ix )  =  A(|(.v);  and 


—  oo  <  X  <  C 


1  X  ^  c 


o  -oo  <  .V  <  0 

H  ix)  =  F  (x+c)  —  F  (c— ) 


1  -  F  (r— ) 


x  >  0 


if  F  (<. — )  <  1,  otherwise  H  ix)  =  A0(.v). 

In  terms  of  the  new  variables  p.  Z,  and  ME,  the  cost  function  Eq.  (Cl)  becomes 
Pr{X  >  Y  +  cl  =  p  Pr\Z  +  c  >  Y  +  c  ) 

+  (  1  -  p  )  Pr  {  IT  >  y  +  c ) 

=  p  Pr\Z  >  E) .  (C19) 

Clearly,  H  has  no  effect  on  the  cost  function  Pr  |  X  ^  >'  +  c ),  only  our  choice  of  p  and  Z  influence 
it.  The  latter  choice  is  constrained  by 

EX  =(!-/?)  EH  +  pic  +  EZ)  ^  a 


,  ,  ^  a  -  (  1  -  p  )  EH 

l .  n;  —  ( 


so  that  the  widest  choice  of  /  is  permitted  when  H  =  0  and 


/./  $  -  i  —  a  ip) 

P 
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Using  this  decomposition,  we  can  reformulate  Eq.  (C2a)  in  the  following  way: 

Program  I  v  =  sup  inf  p  Pr  {  Z  ^  Y ) ,  (C20) 

(/>./>  £/  5,  j  (p)  >  5s  h 

Program  ll.v=  inf  sup  p  Pr  [  Z  ^  Y  )  .  (C20) 

t  £>  b  (p.Z)  u.  y  a  <p> 


Games  Eqs.  (C2a)  and  (C20a)  are  equivalent  in  the  following  sense:  If  T0,  />n,  and  Z0  are  related 
as  in  Eq.  (Cl  8),  then  |(p0,Z0),  >'0!  is  a  saddle-point  for  Eq.  (C20a)  if  and  only  if(Xlh  Ku)  is  a  saddle- 
point  for  Eq.  ( C 2 a ) .  and,  of  course,  the  resulting  values  of  both  games  arc  the  same.  Therefore,  solv¬ 
ing  Eq.  (C20a)  is  entirely  equivalent  to  solving  Eq.  (C 2a). 

Using  Eq.  (C20a),  we  can  derive  the  only  candidate  saddle-point  for  Eq.  (C2a)  in  the  following 
way.  Suppose  that  ((/?„, Z(|).  >0 }  is  a  saddle-point  so  that 


p  Pr[Z  >  >'o  1  <  Po  Pr{Z0>  T0)  <  A>o  M  Zo  >  Y  )  (C21) 

for  all  admissible  I  (p,Z),  T}.  Then,  in  particular,  we  have 

Po  Pr{Z  ^  y0l  <p0Pr[Z0>  I  ^  Po  Pr  1  zo  ^  ^  1  (C22) 


for  all  (Z,  Y)  such  that  j(/?0,Z),  T)  is  allowable.  Ignoring  momentarily  the  trivial  possibility  that 
Po  =  0,  Eq.  (C22)  implies  that  (Z0,  T0)  must  be  a  saddle-point  of  Eq.  (C2a)  with  constants 

a'  =  a  (p0)  =  ~ —  c  ,  b'  =  b  ,  c'  =  0 .  (C23) 

P  o 

Since  Eq.  (C6a)  gives  the  unique  solution  to  Eq.  (C2a)  when  c  =  0,  we  conclude  that  (Z0,  Y0)  must 
have  the  distributions  F0  and  G0  obtained  when  the  constants  Eq.  (C23)  are  substituted  into  Eq.  (C6a). 
The  corresponding  value  of  this  game,  as  a  function  of  p0,  is 


v0  (p0) 


Po 


1  - 


2  a  ( Po ) 

Ppa  W 
2b 


a  (p0)  ^  b 


a  (/?0)  ,  b  . 


(C24) 


We  now  show  that  Eq.  (C21)  fixes  a  value  for  /?0  as  well.  If  |(/?0,  Z(1),  Efl|  is  a  saddle-point  for  Eq. 
(C20a),  then  the  left-hand  bound  in  Eq.  (C21)  implies  that 

v0  =  max  v0  (/7 ) . 

OsS  p  $  l 

Using  this,  we  may  explicitly  find  the  only  possible  saddle-point.  The  following  facts  will  be  useful: 


FACTS: 

(1): 


The  maxima  of  i'l((/>)  over  the  range  0^/7^  I  is  attained  by 


a 

c 

1  V  2c  +  b 

a  ^  c  +  y 

,+a/I  +  T 

1 

a  >  C  +  y 

i  +  a/i  +  t 

(C’25) 


and  note  that  Po  ^  a  /  c  when  c  >  0. 


NRL  RLPORT  8971 


(2):  Define  g  ip)  on  the  interval  0  <  p  <  a  /  c  by 

b  be 


gip)  =  1  - 


a  ( p )  2a2 ( p ) 

Then  g(p0)  =  0  if  0  <  p0  <  1,  and  g  ( p0 )  >  0  if  p0  =  1  . 

(3):  a  ( p0 )  ^  b  for  all  a,  b  >  0,  and  c  >  0,  where  p0  is  as  defined  in  Eq.  (C25). 

Therefore,  based  on  facts  (1)  and  (3),  Lemma  1,  and  the  comments  above,  the  only  possible 
saddle-point  for  the  game  Eq.  (C20a)  is  p0,  Z0  —  H0  and  T0  —  G0  where  p0  is  given  in  Eq.  (C25)  and 

(*) , 


H0(x)  =  U 
G0(x)  = 


I0.26)p0)l 


A0(x) . 


(C26a) 

(C26b) 


Remark:  Note  that  a  >  0  implies  that  a  (po)  = - c  >  0,  so  that  Eq.  (C26b)  is  always  well- 

Po 

defined. 

H0  and  G0  are  obtained  by  substituting  Po  above  into  Eq.  (C23),  substituting  the  resulting  con¬ 
stants  into  Eq.  (C6a),  and  taking  H0  =  F0.  The  corresponding  value  of  the  game  is 


v0 


1+  * 
c 


1  - 


-Vi^T 


2( a  -  c  ) 


a  s*  c  +  j 


a  >  c  + 


1  + 


V 


1  +  ^  /  1  + 


We  have  shown  that  \(p0,Z0),  T0)  is  the  only  candidate  for  a  saddle-point  for  the  game  Eq. 
(C20a);  let  us  now  verify  that  this  is  indeed  a  saddle-point.  Let  ( (p,Z),T)  be  any  admissible  triple, 
and  suppose  that  Z  —  H  and  Y  ~  G .  Then 

p  Pr\Z  >  T0)  -  P  C  Co  (*)  dH  (x) 

•jo 


=  P 


< 


1  - 

1  - 

1  - 

1  - 


+  - 


bp 


a  (p0) 
bp 


=  P  R  W  + 


a  (p0) 
b 

a  (p0) 
b 

a  ( Po ) 
b _ 

a  (p0)  2a 2  (p0) 
ba 


r 


/0  ^  10.2a  (/»„>  i 


(x)  dH  (x) 


+ 


2  a  W 

bpa  ip) 
2a2  (p0) 

be  ) 


r  x  dn  (x) 

JO 


+ 


ba 


2  a2(p0) 


2a2  (p0) 
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From  fact  (2)  it  follows  that  pg  ( p0 )  <  PoS  (Po>  and  therefore 

ba 


p  Pr{Z  ^  T0I  <  Po  g  W  + 


P  o 


1  - 


2a2(p0) 
b 


2  a  ( p0 ) 


=  v0. 


The  proof  of 


pQPr{Z0>  Y]  >  v0 


for  all  allowable  Y  is  similar  to  the  proof  of  Lemma  1  and  so  is  omitted. 


We  conclude  that  ((p0,Z0),  T0)  is  unique  saddle-point  for  Eq.  (C20a)  and  that  v0  is  the 
corresponding  value.  Recalling  the  equivalence  between  the  games  Eqs.  (C20a)  and  (C2a)  when 
and  X  are  related  by  Eq.  (C18)  (cf.  remarks  following  Eq.  (C20a)),  we  have  therefore  proved  the 
following: 

Theorem:  Consider  the  two-player,  zero-sum  game  given  by  Eq.  (C2a).  This  game  has  a  value  v0  and 
unique  saddle-point  strategies  —  Fq  and  To  —  Go.  These  are  given  in  Lemma  1  for  the  case  c  =  0, 
and  for  the  case  c  >  0  by 


v0  = 


1  +  -* 
c 


1  - 


“aA+t) 


0<c  +  T 


1  + 


2(  a  -  c  ) 

F0(x)  =  Po  G,0  2a(po,|  (x)  +  ( 1  -  p0)  A0U), 


Go  (x ) 


a  (p0) 


U 


10.2a  <P0)I 


(x-c)  +1  — ^ 


a  >  c  +  — 


U0(x) , 


a/^ 

V 


1  +  -w  1  + 


a  ( Po ) 


where  a  (p)  =  a  /  p  -  c  and 


c 

1  -J 2c  +  b 

a  ^  c  +  — 

Po  = 

1 

a  >  c  +  j 

-aAW 

(C27a) 

(C27b) 

(C27c) 


Remark:  Note  that  some  of  the  quantities  above  are  indeterminanl  when  c  =  0  Nevertheless  the 
saddle-point  strategies  and  the  value  in  Eq.  (C27a)  lend  continuously  to  those  of  Lemma  1  as  r  —  0. 
To  see  this,  fix  a  >  0  and  b  >  0  and  denote  by  Vo(c),  A"o(c),and  Ko(c),  the  value  and  saddle- 
points  for  the  game  Eq.  (C2a)  with  parameters  a,  6,  and  c.  As  c  *0,  we  have  by  elementary  expan¬ 
sion 


V 


2  b2 


+  o  (r3) 


and  therefore 


I* 


$1 

vl 
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We  also  have,  trivially. 


c  +  j  1  + 


b  +  o  (c) 


Therefore,  we  conclude  that  as  c  —  0, 
v0  (c)  —  v0  (0) , 

X0  (c)  —  X0  (0)  (in  law) , 

T0  (c)  — 1 •  T0  (0)  (in  law) , 

as  claimed. 


’>v>,  ■  * 


